Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
Luxembourg, Nitzan Ben-Dov, Dvir Marew, Rufael Fekadu Teitelbaum, Dvir Adereth, Ieva Vebraite Hanein, Yael
Luxembourg, Nitzan
Ben-Dov, Dvir
Marew, Rufael Fekadu
Teitelbaum, Dvir
Adereth, Ieva Vebraite
Hanein, Yael
Supervisor
Department
Natural Language Processing
Embargo End Date
Type
Journal article
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
Finger gestures are a critical element in human communication, and as such, finger gesture recognition is widely studied as a human-computer interface for state-of-the-art prosthetics and optimized rehabilitation. Surface electromyography (sEMG), in conjunction with deep learning methods, is considered a promising method in this domain. However, current methods often rely on cumbersome recording setups and the identification of static hand positions, limiting their effectiveness in real-world applications. The protocol we report here presents an advanced approach combining a wearable surface EMG and finger tracking system to capture comprehensive data during dynamic hand movements. The method records muscle activity from soft printed electrode arrays (16 electrodes) placed on the forearm as subjects perform gestures in different hand positions and during movement. Visual instructions prompt subjects to perform specific gestures while EMG and finger positions are recorded. The integration of synchronized EMG recordings and finger tracking data enables comprehensive analysis of muscle activity patterns and corresponding gestures. The reported approach demonstrates the potential of combining EMG and visual tracking technologies as an important resource for developing intuitive and responsive gesture recognition systems with applications in prosthetics, rehabilitation, and interactive technologies. This protocol aims to guide researchers and practitioners, fostering further innovation and application of gesture recognition in dynamic and real-world scenarios.
Citation
N. Luxembourg, D. Ben-Dov, R. F. Marew, D. Teitelbaum, I. V. Adereth, and Y. Hanein, “Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision,” J Vis Exp, no. 217, p. e67766, Mar. 2025, doi: 10.3791/67766.
Source
Journal of Visualized Experiments
Conference
Keywords
Subjects
Source
Publisher
MyJoVE Corporation