K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations
Creators
- 1. Korea Advanced Institute of Science and Technology (KAIST)
- 2. Khalifa University
Description
ABSTRACT: Recognizing emotions during social interactions has many potential applications with the popularization of low-cost mobile sensors, but a challenge remains with the lack of naturalistic affective interaction data. Most existing emotion datasets do not support studying idiosyncratic emotions arising in the wild as they were collected in constrained environments. Therefore, studying emotions in the context of social interactions requires a novel dataset, and K-EmoCon is such a multimodal dataset with comprehensive annotations of continuous emotions during naturalistic conversations. The dataset contains multimodal measurements, including audiovisual recordings, EEG, and peripheral physiological signals, acquired with off-the-shelf devices from 16 sessions of approximately 10-minute long paired debates on a social issue. Distinct from previous datasets, it includes emotion annotations from all three available perspectives: self, debate partner, and external observers. Raters annotated emotional displays at intervals of every 5 seconds while viewing the debate footage, in terms of arousal-valence and 18 additional categorical emotions. The resulting K-EmoCon is the first publicly available emotion dataset accommodating the multiperspective assessment of emotions during social interactions.
+---------------------------------------+
| Changelog (last updated: Jul 7, 2020) |
+---------------------------------------+
* Version 1.0.0 (Jul 7, 2020):
- Updated emotion_annotations.tar.gz:
- Updated aggregated external annotations to support the reproduction of technical validation results.
* Version 0.2.0 (May 11, 2020):
- Added data_quality_tables.tar.gz
- Updated emotion_annotations.tar.gz
- Newly added aggregated external annotations.
- Updated metadata.tar.gz:
- Added a new column to data_availability.csv to show the availability of aggregated external annotations.
* Version 0.1.0 (Apr 25, 2020):
- Added debate_audios.tar.gz
- Added debate_recordings.tar.gz
- Added e4_data.tar.gz
- Added emotion_annotations.tar.gz (self, partner, external)
- Added metadata.tar.gz
- Added neurosky_polar_data.tar.gz
Notes
When applying for the dataset, please fill in the user agreement form as well (https://forms.gle/qmK8TcEDtw56Nqev5).
Please read the terms of usage carefully and don't hesitate to contact us if you have any questions.
Note that you need to use the same email address/mention the user id that you used in your Zenodo request when filling in the user agreement form.
Also, please answer in detail to the question "For what purpose do you intend to use this data?"
We may not accept your request if we find your justification insufficient upon the review.
After filling in the user agreement form, please do not forget to submit your request on Zenodo so that we can share the dataset.
Files
Restricted
The record is publicly accessible, but files are restricted to users with access.
Request access
If you would like to request access to these files, please fill out the form below.
You need to satisfy these conditions in order for this request to be accepted:
A user must fill out the following form to be granted access to the dataset: https://forms.gle/DUAERhHqf51kyt4Y9
Once the form is submitted, we will review it and decide whether to grant or deny access.
You are currently not logged in. Do you have an account? Log in here
Additional details
Related works
- Is cited by
- Preprint: arXiv:2005.04120 (arXiv)
- Journal article: 10.1038/s41597-020-00630-y (DOI)