Published February 17, 2026 | Version v1
Dataset Open

MultiPhysio-HRC: Multimodal Physiological Signals Dataset for industrial Human-Robot Collaboration

  • 1. ROR icon University of Applied Sciences and Arts of Southern Switzerland
  • 2. Scuola universitaria professionale della Svizzera italiana - Polo universitario Lugano
  • 3. SUPSI
  • 4. ROR icon Universidad de Zaragoza
  • 5. Instituto Universitario de Investigación en Ingenería de Aragón [I3A]
  • 6. ROR icon Università della Svizzera italiana

Description

MultiPhysio-HRC is a multimodal dataset collected to study mental state perception in industrial Human–Robot Collaboration (HRC) scenarios. The dataset includes synchronized physiological, audio, and facial data acquired during controlled cognitive tasks, immersive virtual reality experiences, and real-world industrial disassembly tasks performed both manually and in collaboration with a robot. Recorded modalities include EEG, ECG, electrodermal activity (EDA), respiration (RESP), electromyography (EMG), together with voice recordings and facial action units. Ground-truth annotations were obtained using validated self-assessment questionnaires, including STAI-Y1, NASA-TLX, SAM, and NARS, enabling the study of stress, cognitive load, and affective states. MultiPhysio-HRC is designed to support research in affective computing, multimodal learning, and human-aware robotics, and to foster the development of adaptive robotic systems aligned with the human-centric vision of Industry 5.0.
The dataset documentation, structure, and feature descriptions are provided in the accompanying README.

Files

features.zip

Files (15.7 GB)

Name Size Download all
md5:00ac3956455aa9061efb70f2fe7ec196
410.6 MB Preview Download
md5:b1eb9896df055f6e19877a8f0989b732
39.6 kB Preview Download
md5:887165cda42dfa564b74c22f2802bbaf
4.9 kB Preview Download
md5:75d97dc1327e5af49f9cce8d9e729867
15.3 GB Preview Download
md5:41de7cdb7ae2f24e4f2a0a690ba65f4f
5.2 kB Preview Download

Additional details

Related works

Is described by
Publication: 10.3390/robotics14120184 (DOI)

Funding

European Commission
Fluently - Fluently - the essence of human-robot interaction 101058680