CUES - Confusion and Understanding: Expressions under Stress

The CUES dataset consists of facial features extracted via OpenFace2.2 of 40 participants receiving a board game explanation, both in a stress and a control condition. The dataset contains one extracted-features file per condition. The felt understanding and confusion throughout each explanation were self-annotated using RankTrace and are provided in the corresponding .csv files. 

The data is stored as .csv files in the following structure:

• Feature files: Formatted as participantid_condition_features.csv, containing facial features for each frame extracted via OpenFace2.2, for all participants.
• Annotation files. Formatted as participantid_condition_annotation.csv, containing self-labeled annotations of perceived understanding and confusion obtained via RankTrace, connecting each frame.

Conditions

Each participant received a board game explanation in a stressful and neutral scenario:

• Stress: Explanation was done under time pressure, performed by a researcher acting strictly and wearing a lab coat, and a test of the rules was done after the explanation.
• Neutral: Explanation was done without time pressure, performed by a collaborator posing as another study participant, and no test was done.

This dataset is intended for research purposes only, specifically for developing and evaluating rPPG and heart rate estimation algorithms under varying lighting and heart rate conditions.