CV-based self-diagnosis telemedicine application
This post is a short overview of an Abto Software healthcare project.
Markerless human pose detection to benefit physical therapy — project overview
Our client is a health-focused organization that provides comprehensive products for the healthcare industry. The portfolio of the reputable company comprises solutions that benefit healthcare institutions and patients, from enterprise-level management platforms to user-friendly mobile applications.
Our partner was looking for knowledge and experience in delivering human body pose detection and analysis (our former successful cooperation was focused around performing personal medical device integration). Having expertise in building and implementing advanced solutions for accurate pose estimation and analysis, our company smoothly upgraded another solution.
Sensorless human body detection to transform exercise sessions: Our approach
Our team has entered into cooperation to modernize a custom telemedicine application supporting specialists in improving patient outcomes by enhancing personalized treatment and better-tailored exercise guidance. Our engineers quickly designed a solution that processes different exercises, for example, cervical flexion.
Abto Software’s main goal:
- Initial investigation and identification of the best techniques for accurate motion tracking and analysis to enable MSK telerehabilitation
- Efficient customization and implementation of the chosen technique for precise movement assessment to empower therapeutics monitoring
At the first stage, we trained the CV-algorithm to recognize human motion on ready-captured video materials. During the next stages, we implemented additional CV-algorithms to process human movement in real-time, allowing end-users to leverage helpful feedback during exercising.
Abto Software took over:
- Business logic development
- Demo product design
- Computer vision technique implementation
a. In-depth research
b. Application prototyping
- UI/UX design
CV self-diagnosis telemedicine app: Our solution
Our application was created to accelerate physical therapy:
- The system guides patients through exercises automatically tracking every movement
- The system, after analyzing patient performance and adherence, transfers processed health indicators to the attending clinicians who can then adjust the prescribed treatment program
The application is intended to streamline different domains:
- Digital rehabilitation
- Digital therapeutics
- Spinal rehab
- Sports medicine & orthopedics
CV camera-based telemedicine app: The challenges
Measurement points
At the discovery phase, we had to determine the correct measurement points for accurate limb assessment. This challenge was resolved by monitoring the ear-nose line segment.
Viewpoint variation
We faced viewpoint variation, which means that recognized shapes change and alter determined features. That’s why our engineers have used different datasets to train the algorithms.
Pose variation
Another issue — pose variation, which means the recognized objects aren’t steady bodies and can be deformed. To handle this problem, our engineers made sure the datasets included numerous possible variations of pose.
Summing up
Abto Software has joined the project to assist our client, a mature healthcare-focused organization in providing a user-friendly telemedicine application to empower physical therapists and patients undergoing rehabilitation. Our experts have utilized advanced technology, in particular computer vision, to facilitate remote monitoring and transform healthcare delivery.
By leveraging:
We assist:
- Healthcare businesses that prioritize patient-first care
- Physical therapists embracing innovation
And benefit:
- Physiotherapy patients undergoing physiotherapy and rehabilitation
- Those patients who suffer chronic conditions and prefer accessible services
