Web Camera-Based Gamified Rehabilitation System for Improving Fine Motor Skills: Pilot Study

Abstract

The system integrates a Python-based hand tracking module using a standard webcam with Unity, enabling real-time calculation of finger range of motion (ROM) angles and virtual hand visualization within interactive games. The pilot study was conducted with 40 healthy participants (aged 19–25) to evaluate usability and feasibility, while ROM measurements were validated against goniometer readings in a test with four participants. The system assessed distal interphalangeal (DIP), proximal interphalangeal (PIP), and thumb interphalangeal (IP) joints. To ensure consistency, participants gripped predefined cylindrical objects during measurements, reducing variability. The system demonstrated strong correlations with goniometer measurements (r = 0.585–0.998), particularly for PIP joints (e.g., 0.998 for the ring finger). An average Usability test score of 82.69 indicated high usability, and low latency (<2 milliseconds) ensured smooth user interaction. These findings suggest that the system provides accurate ROM tracking and an engaging rehabilitation experience. While promising, further validation with larger datasets is required to confirm its reliability and explore its potential for clinical populations.