MultiPhysio-HRC: Multimodal Physiological Signals Dataset for industrial Human-Robot Collaboration
Authors/Creators
-
1.
University of Applied Sciences and Arts of Southern Switzerland
- 2. Scuola universitaria professionale della Svizzera italiana - Polo universitario Lugano
- 3. SUPSI
-
4.
Universidad de Zaragoza
- 5. Instituto Universitario de Investigación en Ingenería de Aragón [I3A]
-
6.
Università della Svizzera italiana
Description
MultiPhysio-HRC is a multimodal dataset collected to study mental state perception in industrial Human–Robot Collaboration (HRC) scenarios. The dataset includes synchronized physiological, audio, and facial data acquired during controlled cognitive tasks, immersive virtual reality experiences, and real-world industrial disassembly tasks performed both manually and in collaboration with a robot. Recorded modalities include EEG, ECG, electrodermal activity (EDA), respiration (RESP), electromyography (EMG), together with voice recordings and facial action units. Ground-truth annotations were obtained using validated self-assessment questionnaires, including STAI-Y1, NASA-TLX, SAM, and NARS, enabling the study of stress, cognitive load, and affective states. MultiPhysio-HRC is designed to support research in affective computing, multimodal learning, and human-aware robotics, and to foster the development of adaptive robotic systems aligned with the human-centric vision of Industry 5.0.
The dataset documentation, structure, and feature descriptions are provided in the accompanying README.
Files
features.zip
Files
(15.7 GB)
| Name | Size | Download all |
|---|---|---|
|
md5:00ac3956455aa9061efb70f2fe7ec196
|
410.6 MB | Preview Download |
|
md5:b1eb9896df055f6e19877a8f0989b732
|
39.6 kB | Preview Download |
|
md5:887165cda42dfa564b74c22f2802bbaf
|
4.9 kB | Preview Download |
|
md5:75d97dc1327e5af49f9cce8d9e729867
|
15.3 GB | Preview Download |
|
md5:41de7cdb7ae2f24e4f2a0a690ba65f4f
|
5.2 kB | Preview Download |
Additional details
Related works
- Is described by
- Publication: 10.3390/robotics14120184 (DOI)
Software
- Repository URL
- https://automation-robotics-machines.github.io/MultiPhysio-HRC.github.io/
- Programming language
- Python