Conference paper Open Access

Towards a Professional Gesture Recognition with RGB-D from Smartphone

Pablo Vicente Monivar; Sotiris Manitsaris; Alina Glushkova

Abstract. The goal of this work is to build the basis for a smartphone application that provides functionalities for recording human motion data, train machine learning algorithms and recognize professional gestures. First, we take advantage of the new mobile phone cameras, either infrared or stereoscopic, to record RGB-D data. Then, a bottom-up pose estimation algorithm based on Deep Learning extracts the 2D human skeleton and exports the 3rd dimension using the depth. Finally, we use a gesture recognition engine, which is based on K-means and Hidden Markov Models (HMMs). The performance of the machine learning algorithm has been tested with professional gestures using a silk-weaving and a TV-assembly datasets.

Files (2.5 MB)
Name Size
ICVS_Paper VFinal.pdf
md5:f8e0f320f11ed9fd04d0f045a73d007a
2.5 MB Download
17
13
views
downloads
All versions This version
Views 1717
Downloads 1313
Data volume 33.0 MB33.0 MB
Unique views 1515
Unique downloads 1313

Share

Cite as