Published March 21, 2022 | Version v1
Dataset Open

Datasets for Multimodal Biosensing for Vestibular Network-Based Cybersickness Detection

  • 1. University of Glasgow
  • 2. Shanghai Jiao Tong University
  • 3. University of California, San Francisco

Description

These are the datasets about the experimental group (N=20, where N is the sample size, that is, 20 participants in total) and control group (N=20, where N is the sample size, that is, 20 participants in total) for our published paper entitled "Multimodal Biosensing for Vestibular Network-Based Cybersickness Detection", DOI: 10.1109/JBHI.2021.3134024. 

1. What do these datasets include?

There are 40 participants' data in 40 folders, respectively. Each folder includes EEG data, Questionnaires, and answers as well as other non-EEG biometrics and memory test result of the cognitive task.


1.1 EEG data
All EEG data is either *.easy file or *.info file. The *.easy file is the raw EEG data. The *.info file is the information (e.g., EEG montage) paired with those raw EEG data. The *.info file can be simply readable by any Notepad software. The *.easy file can be readable by Neuroelectrics's plugin for EEGLAB (https://www.neuroelectrics.com/wiki/index.php/EEGLAB). Note, most of the participants' EEG data is a single easy file, but due to technical problems, few participants' EEG data consists of some separated easy files. Please use the function 'merge dataset' in the EEGLAB to merge them, and then use the following markers to extract segments of interest.

All received EEG markers are integer numbers. Specifically, the markers are as follows:

For control group:
a) The 'target' stimuli in the cognitive task: 16
b) The 'distractor' stimuli in cognitive task:32
c) The end of Baseline_1(that is, before the first cognitive task): 37
d) The end of Baseline_2(that is, before the round 1 neutral task): 47
e) The end of Baseline_3(that is, before the round 2 neutral task): 57
f) The end of Baseline_4(that is, before the second cognitive task): 67
g) The end of FMS reporting during the round 1 neutral task: 100
h) The end of FMS reporting during the round 2 neutral task: 101

For experimental group:

a) The 'target' stimuli in the cognitive task: 16
b) The 'distractor' stimuli in cognitive task:32
c) The end of Baseline_1(that is, before the first cognitive task): 37
d) The end of Baseline_2(that is, before the tunnel travel task): 47
e) The end of Baseline_3(that is, before the rollercoaster task): 57
f) The end of Baseline_4(that is, before the second cognitive task): 67
g) The end of FMS reporting during the Tunnel travel task: 100
h) The end of FMS reporting during the Rollercoaster task: 101

1.2 Questionnaires

1.2.1 SSQ
All SSQ questionnaires are named as xxx_QuestionnaireResult.csv, where xxx stands for the timestamps.

1.2.2 FMS

For control group:
All FMS questionnaires are named as xxx_Nature_FMS_backup.csv or xxx_Bio-data and FMS Nature.csv, where xxx stands for the timestamps and 'Nature' refers to the vection-free neutral task. The FMS scores in the xxx_FMS_backup.csv and xxx_Bio-data and FMS 'Task name'.csv are the exactly same. Unlike the xxx_Bio-data and FMS 'Task name'.csv contains the non-EEG biometrics as well, the xxx_FMS_backup.csv is pure FMS scores and easy to read.

For experimental group:

All FMS questionnaires are named as xxx_Gabor_FMS_backup.csv or xxx_Rollercoaster_FMS_backup.csv or xxx_Bio-data and FMS GaborRacer.csv or xxx_Bio-data and FMS Rollercoaster.csv, where xxx stands for the timestamps and Gabor or GaborRacer refer to the tunnel travel task. The FMS scores in the xxx_FMS_backup.csv and xxx_Bio-data and FMS 'Task name'.csv are the exactly same. Unlike the xxx_Bio-data and FMS 'Task name'.csv contains the non-EEG biometrics as well, the xxx_FMS_backup.csv is pure FMS scores and easy to read.

1.3 Non-EEG biometrics
All non-EEG biometrics are named as xxx_Bio-data 'Task name'.csv, where 'Task name' refers to 'VA' (that is the cognitive task), or 'Nature' (for the control group) or 'GaborRacer' (for the experimental group) or 'Rollercoaster' (for the experimental group). The column information is as follows:
Column A: time
Column Q: PPG raw data (the left index finger)
Column R: Fingertip temperature (the left middle finger)
Column S: Forehead temperature
Column T: VR hermetic space temperature

The data in other columns are not used in this study.

1.4 The memory test result of the cognitive task

Memory test result: xxx_CheckMemoryResult.csv, where xxx stands for the timestamps.

Column A: time

Column B: memory test result (Correct/Wrong)

Column C: the number of the target (green sunfish)

Column D: the reported number of the target in the memory test

Files

Additional details

Funding

European Commission
ViAjeRo - ViAjeRo: Virtual and Augmented Reality passenger experiences 835197