Conference paper Open Access
Real-time gestural control of robot manipulator through Deep Learning human-pose inference
Bujalance Martín, Jesús; Moutarde, Fabien
With the raise of collaborative robots, human-robot interaction needs to be as natural as possible. In this work, we present a framework for real-time continuous motion control of a real collaborative robot (cobot) from gestures captured by an RGB camera. Through deep learning existing techniques, we obtain human skeletal pose information both in 2D and 3D. We use it to design a controller that makes the robot mirror in real-time the movements of a human arm or hand.
Files
(2.0 MB)
| Name | Size | |
|---|---|---|
|
article_icvs2019.pdf
md5:b600fd314152abe2f3df6c603ad1b26a |
2.0 MB | Download |
28
40
views
downloads
| All versions | This version | |
|---|---|---|
| Views | 28 | 28 |
| Downloads | 40 | 40 |
| Data volume | 78.9 MB | 78.9 MB |
| Unique views | 25 | 25 |
| Unique downloads | 38 | 38 |
Indexed in
- Publication date:
- September 23, 2019
- DOI:
-
- Grants:
-
European Commission:
- CoLLaboratE - Co-production CeLL performing Human-Robot Collaborative AssEmbly (820767)
- Communities:
- License (for files):
- Creative Commons Attribution 4.0 International