Auditory Selective Attention Switch in a Virtual Reality Classroom Environment

General

The audio-visual Auditory Selective Attention VR Proof of Concept (asaVRpoc) project serves to investigate the auditory selective attention switch in a close-to-real-life classroom setting. This dataset consists of a Unity project and Matlab code used to collect data on the voluntary switching of auditory selective attention in a virtual reality classroom scenario.

The dataset contains:

• Unity project for visual display and the experiment structure
• Matlab code for experiment preparation and HpFT measurement
• Data collected in the experiment (experiment performance, head tracking, questionnaires)

Experiment preparation using Matlab

The code and software used to prepare the experiment is provided in the folder "matlab_asaVRpoc".

The Matlab code used to prepare the trials for each participant as well as to measure the HpTFs. For the HpTF measurements, the  ITA Toolbox for Matlab was used and is provided (https://git.rwth-aachen.de/ita/toolbox commit hash: 598675ef704c178365f53d41e03ff4b11dea390f). A developmental version of Virtual acoustics (VA) 2020b (https://www.virtualacoustics.org/VA/overview/) is provided.

Software requirements:

• Matlab 2019a or higher
• ITA Toolbox for Matlab installed

Experiment conduction in Unity

The Unity project is provided in the folder "unity_pc_asaVRpoc".

Therefore, a virtual classroom with some basic furniture is provided. The used models, prefabs and plugins can be found in the Assets folder.

Note that the acoustic stimuli are NOT provided with this Unity project. The stimuli are available on request from the Institute for Hearing Technology and Acoustics, RWTH Aachen University.

This Unity project was intended for the use in virtual reality using an HMD and respective controllers for input. However, it can also be used on a desktop pc. The mode can be changed using the "VRMode" toggle as described below.
The audio reproduction is realized using the Unity plugin for Virtual Acoustics (VA, http://www.virtualacoustics.org/).

Software requirements:

• Unity 2019.4.21.f1.
• SteamVR 1.19.7
• Virtual Acoustics v2021a, VAUnity: https://git.rwth-aachen.de/ita/VAUnity

Data evaluation

The collected data is provided in the folder "dataEvaluation_asaVRpoc". This folder contains three types of data: the raw data collected in the experiment (reaction times and error rates), the head tracking data and responses from the simulator sickness questionnaire (before and after the experiment) and the igroup presence questionnaire (after the experiment). Matlab code for the evaluation of the head tracking data and the questionnaires is provided.