Audiovisual recordings of unscripted monologues

Contact info:

stefan.debener@uni-oldenburg.de, g.grimm@uni-oldenburg.de,volker.hohmann@uni-oldenburg.de, mareike.daeglau@uni-oldenburg.de, juergen.otten@uni-oldenburg.de,bojana.mirkovic@uni-oldenburg.de

Context:

This data set was recorded to investigate the influence of visual cues in audiovisual virtual environments on auditory attention decoding and cortical tracking of speech

Data collection:

• Subjects (3f/2m/1d) were instructed to tell non-scripted stories.
• Subjects were equipped with in-ear headphones "BatAndCat Sound Labs binaural 4-microphone BTE-RIC headset" to play babble noise with a level of 65 dB SPL in the noise conditions (see naming convention below)
• Recordings were done using a Canon "EOS 700D" (Firmware cersion 1.1.4)
• Videos have a framerate of 25 fps
• Camera set up such that subjects face the camera. Face and shoulders visible, face at the center of the video
• Audio has a sampling rate of 48kHz. Recorded using microphone  "Neumann KM-184" close to the speaker

Date of data collection:

June 2021

Location:

Carl-von-Ossietzky university of Oldenburg. building W30, Gesture Lab

Naming conventions:

The file names are structured as follows:

• Subject ID
• Take number
• MG, if babble noise was played over in-ear headphones
• LS, only for subject 5 Take 12. In this recording, the subject had lipstick applied beforehand
• BR, only for subject 4 Takes 11 and 12. Subject wore glasses during these takes
• .mp4 indicating file type

Data manipulations:

Videos were cut to length using DaVinci Resolve

Link to publication:

https://doi.org/10.18154/RWTH-2023-05549

Funding:

This research is funded by a research grant from the German Research Foundation (Deutsche Forschungsgemeinschaft; SPP 2236 project 444761144)