Conference paper Open Access

Real-time gestural control of robot manipulator through Deep Learning human-pose inference

Bujalance Martín, Jesús; Moutarde, Fabien

With the raise of collaborative robots, human-robot interaction needs to be as natural as possible. In this work, we present a framework for real-time continuous motion control of a real collaborative robot (cobot) from gestures captured by an RGB camera. Through deep learning existing techniques, we obtain human skeletal pose information both in 2D and 3D. We use it to design a controller that makes the robot mirror in real-time the movements of a human arm or hand.

Files (2.0 MB)
Name Size
article_icvs2019.pdf
md5:b600fd314152abe2f3df6c603ad1b26a
2.0 MB Download
43
64
views
downloads
All versions This version
Views 4343
Downloads 6464
Data volume 126.3 MB126.3 MB
Unique views 4040
Unique downloads 6161

Share

Cite as