CV-Powered Personal Coach Platform for Amateur Athletes

AI-Powered approach in dance education.

Yuliya Sychikova
COO @ DataRoot Labs
11 May 2020
4 min read
CV-Powered Personal Coach Platform for Amateur Athletes
Client Services
Industries
Virtual Assistant

Summary

  • Millions of amateur athletes worldwide aim to improve their performance, while very few have access to world-class professional coaches and star athletes.
  • Our client develops a platform that provides access to the best coaches in ballet, dancing, martial arts among other sport types.
  • The platform enables aspiring sportsmen to learn different physical activities by using their own devices anytime anywhere. Through any phone or computer camera, the platform compares athlete's movements to the ones of a professional coach while providing live analytics and recommendations on how to improve the performance of each move.
  • Our team used advanced Computer Vision technologies to build an end-to-end MVP that enables professional-to-student physical activity learning from any mobile device.
6
Months
4
Engineers
8+
Technologies

Tech Stack

C++
Caffe
CoreML
Mace
Metal
Python
TensorFlow
TensorflowLite

Timeline

2 Weeks
Data Gathering Pipeline Design
Data Engineer
3 Weeks
Data Labelling and Processing
Data Engineer
2 Weeks
Data Augmentation
Data Engineer
1 Week
Solution Architecture Design
Solution Architect
2 Weeks
Hypothesis Generation & Validation
Deep Learning Researcher
3 Weeks
Architecture Modelling
Deep Learning Researcher
4 Weeks
Teacher Digitalization Algorithm Modelling
Deep Learning Researcher
5 Weeks
Student Pose Estimation & Tracking System Modelling
Deep Learning Researcher
12 Weeks
Training & Tuning Cycle
Deep Learning Researcher
6 Weeks
Optmization for Mobile Device
Deep Learning Engineer
2 Weeks
CoreML / TF Lite / Mace Model Porting
Deep Learning Engineer

Tech Challenge

  • Creation of a custom dataset for the model to enable the capturing of special movements, which are unseen by existing models trained on public datasets.
  • Development of optimized architecture which achieves 100 FPS on average for 2D-pose estimation task on mobile devices in inference mode.
  • Translation of 2D-body points to 3D by a separate model which is running on a server, also responsible for the temporal refinement.
  • Triangulation and 3D reconstruction from multiple, ideally three, video sources.
  • Comparison of digitized coach's video and data inference from a device.

Solution

  • Coach's video digitization: processes video, translates 2D-body points to 3D-body and saves for future comparison.
  • On-server comparison and analytics: compares digitalized teacher video and inferred data from a device and returns analytics.
  • On-device inference: 2D-pose estimation for a student on a device.

Impact

  • We've built a model that creates a dynamic 3D body of a teacher both from 1 source and 3 source video cameras using server GPUs.
  • The model tracks a student athlete using any camera device (computer or mobile device), making all inference on a device and comparing only the results on server GPUs.

Have an idea? Let's discuss!

Book a meeting
Yuliya Sychikova
Yuliya Sychikova
COO @ DataRoot Labs
Do you have questions related to your AI-Powered project?

Talk to Yuliya. She will make sure that all is covered. Don't waste time on googling - get all answers from relevant expert in under one hour.
OR
Send us a note
Optional
File requirements pdf, docx, pptx

Author

Yuliya Sychikova
COO @ DataRoot Labs
Yuliya is a co-founder and COO of DataRoot Labs, where she oversees operations, sales, communication, and Startup Venture Services. She brings onboard business and venture capital experience that she gained at a leading tech investment company in CEE, where she oversaw numerous deals and managed a portfolio across various tech niches including AI and IT service companies.

Co-Authors

Ivan Didur
CTO @ DataRoot Labs
offices map
Kyiv (HQ)
Max Frolov
CEO @ DataRoot Labs
Tel Aviv
Ivan Didur
CTO @ DataRoot Labs
builds and implement AI-powered systems across different verticals to help our clients operate effectively.
GoodFirms Badge