GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interaction (Full Release — All Modalities, ~30 GB)

GroupAffect-4 is a multimodal corpus of co-located four-person group interaction across five structured tasks: T0 resting baseline, T1 hidden-profile decision, T2 mini-negotiation, T3 nominal-group idea generation, and T4 public-goods micro-game. The dataset contains 40 participants in 10 groups with per-participant EmotiBit wrist physiology (PPG, EDA, skin temperature, IMU at ~25 Hz), Tobii Pro Glasses 3 egocentric eye-tracking (~50 Hz), DPA close-talk lapel audio (48 kHz WAV), segment-level and word-level speech transcripts, tablet SAM self-reports (valence, arousal, dominance), task outcome records, demographics, and BFI-44 Big Five personality scores. All signals are synchronised via Lab Streaming Layer (LSL). Room video is excluded from this release.

THIS RECORD — FULL RELEASE (~30 GB)
This record contains all modalities including raw audio WAV files (DPA close-talk lapel microphones, 48 kHz, 16-bit mono) for all 10 sessions and Tobii Pro Glasses 3 eye-tracking for all 10 sessions.

Files in this record:
• affectai_metadata.zip — JSON/TSV sidecars, Croissant 1.1 metadata, README (~1 MB)
• affectai_physio.zip — EmotiBit physiology TSV.GZ, all 10 sessions (~175 MB)
• affectai_beh.zip — Self-report and task TSV, all sessions (~7 MB)
• affectai_transcripts.zip — Transcript and word-level TSV/TXT, all sessions (~5 MB)
• affectai_annot.zip — Session sync and annotation files (~2.2 GB)
• affectai_et_all.zip — Tobii Pro Glasses 3 ET TSV.GZ, all 10 sessions (~5.3 GB)
• affectai_audio_grp-07 to grp-16.zip — Raw WAV audio, one zip per session (~22.9 GB total)

AUDIO ACCESS (Restricted):
The 10 affectai_audio_grp-*.zip files are set to Restricted access due to voice re-identification risk. Click "Request Access" to apply; requests are reviewed and approved by email within 5 business days. A Data Use Agreement prohibits: speaker identification, voice cloning, redistribution, and non-research use. All other files are Open access under CC BY 4.0.

SUBSET RELEASE (<4 GB):
A companion Zenodo record contains all tabular modalities without audio WAV and with ET for 7 of 10 sessions. It is the recommended starting point for most users. Link added to Related Works below.

Modality coverage (200 expected participant-task units):
• EmotiBit physiology: 182/200 (91.0%)
• Tobii eye tracking: 196/200 (98.0%)
• Valence/arousal self-report: 171/200 (85.5%)
• BFI-44 personality: 40/40 (100%)

Eight benchmarkable evaluation targets (B0–B7) cover task-label classification, affective and cognitive state estimation, personality inference, and group-level interaction metrics. Evaluation uses leave-one-group-out cross-validation (split key: group_id).

Processing code and documentation: https://github.com/meisamjam/GroupAffect-4

Responsible AI fields (data limitations, biases, sensitive information, usage restrictions) are documented in croissant_metadata.json (Croissant 1.1) inside affectai_metadata.zip and in the companion NeurIPS 2026 paper.