Conference paper Open Access

Towards a Professional Gesture Recognition with RGB-D from Smartphone

Pablo Vicente Monivar; Sotiris Manitsaris; Alina Glushkova

Abstract. The goal of this work is to build the basis for a smartphone application that provides functionalities for recording human motion data, train machine learning algorithms and recognize professional gestures. First, we take advantage of the new mobile phone cameras, either infrared or stereoscopic, to record RGB-D data. Then, a bottom-up pose estimation algorithm based on Deep Learning extracts the 2D human skeleton and exports the 3rd dimension using the depth. Finally, we use a gesture recognition engine, which is based on K-means and Hidden Markov Models (HMMs). The performance of the machine learning algorithm has been tested with professional gestures using a silk-weaving and a TV-assembly datasets.

Files (2.5 MB)
Name Size
ICVS_Paper VFinal.pdf
2.5 MB Download
All versions This version
Views 5252
Downloads 7373
Data volume 185.1 MB185.1 MB
Unique views 4949
Unique downloads 6969


Cite as