Published December 30, 2023 | Version v1
Dataset Open

ODAQ: OPEN DATASET OF AUDIO QUALITY

Authors/Creators

  • 1. ROR icon Fraunhofer Institute for Integrated Circuits
  • 2. ROR icon Netflix (United States)

Description

ODAQ is a dataset addressing the scarcity of openly available collections of audio signals accompanied by corresponding subjective scores of perceived quality.

ODAQ contains 240 audio samples accompanied by corresponding quality scores obtained via a MUSHRA listening test carried out in parallel at Fraunhofer IIS (Germany) and at Netflix, Inc. (USA).

The quality-rated audio samples are processed versions of the original audio material (also made available). The original audio material consists of:
  • Stereo audio with 44.1 or 48 kHz sampling frequency;
  • 14 music excerpts (8 of which are solo recordings);
  • 11 excerpts from movie-like soundtracks with dialogues mixed with music and effects (separate stems and transcripts are also provided).

Highlights

  • Each of the 240 audio samples is rated by 26 expert listeners (after post-screening).
  • The audio samples are processed by a total of 6 method classes, each operating at 5 different quality levels, plus anchor conditions.
  • The audio samples are processed by methods designed to generate quality degradations possibly encountered during audio coding and source separation.
  • The quality levels for each processing method span the entire quality range.
  • The diversity of the processing conditions, the large span of quality levels, the high sampling frequency of the audio signals, and the pool of international listeners make ODAQ particularly suited for further research into the prediction and analysis of perceived audio quality.
  • The dataset is released with permissive licenses, please refer to _license_disclaimer.txt for full details.

Package Structure

  • The top-level folder contains:
    • _license_disclaimer.txt and _detailed_license.csv detailing the license agreement;
    • DE_systems_info.xls detailing the separation systems used for generating part of the dataset;
    • The following subfolders.
  • ODAQ_unprocessed
    • This folder contains the original "unprocessed" audio material.
  • ODAQ_listening_test
    • This folder contains the audio samples used in the listening test and the listening test results both as individual result files (.xml) and as aggregated .csv table. 
  • ODAQ_training
    • This folder contains the audio samples used during the training phase preceeding the main phase of the listening test.
  • listening_test_instructions
    • This folder contains the instructions provided to the participants in the listening test.
  • ODAQ_DE_raw_outputs
    • This folder contains the raw dialogue estimates output by the separation systems used for the Dialogue Enhancement (DE) scenario.

ICASSP 2024

Please refer to our ICASSP 2024 paper for full details about the listening test and please cite it if you find this dataset useful:

@inproceedings{Torcoli2024ODAQ,
author = {Torcoli, M. and Wu, C. W. and Dick, S. and Williams, P. A. and Halimeh, M. M. and Wolcott, W. and Habets, E. A. P.},
year = {2024},
month = {April},
title = {{ODAQ}: Open Dataset of Audio Quality},
address = {Seoul, Korea},
booktitle={IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP)}
}

Useful Links

Call for Contributions

We make this data available to the community and we welcome contributions and extensions from the community!

Files

ODAQ.zip

Files (1.0 GB)

Name Size
md5:9b4c1eba479ea698995798523eb80999
1.0 GB Preview Download