Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality

Dick S, Tompson C, Wu CW, Torcoli M, Delgado P, Williams PA, Habets E. Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality. In: Express Paper. Audio Engineering Society; 2024. Paper 263. Available from: https://aes.org/publications/elibrary-page/?id=22721

@inproceedings{Dick2024_22721,
  author = {Dick, Sascha and Tompson, Christoph and Wu, Chih-Wei and Torcoli, Matteo and Delgado, Pablo and Williams, Phillip A. and Habets, Emanuël},
  title = {{Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality}},
  note = {Paper 263},
  year = {2024},
  month = sep,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22721}
}

TY  - CPAPER
TI  - Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality
AU  - Dick, Sascha
AU  - Tompson, Christoph
AU  - Wu, Chih-Wei
AU  - Torcoli, Matteo
AU  - Delgado, Pablo
AU  - Williams, Phillip A.
AU  - Habets, Emanuël
M1  - Paper 263
PY  - 2024
DA  - 2024/09/27
UR  - https://aes.org/publications/elibrary-page/?id=22721
PB  - Audio Engineering Society
LA  - en
AB  - The Open Dataset of Audio Quality (ODAQ) was recently introduced to address the scarcity of openly available audio datasets with corresponding subjective quality scores. The dataset, released under permissive licenses, comprises audio material processed using six different signal processing methods operating at five quality levels, along with corresponding subjective test results. To expand the dataset, we provided listener training to university students to conduct further subjective tests and obtained results consistent with previous expert listeners. We also showed how different training approaches affect the use of absolute scales and anchors. The expanded dataset now comprises results from three international laboratories providing a total of 42 listeners and 10080 subjective scores. This paper provides the details of the expansion and an in-depth analysis. As part of this analysis, we initiate the use of ODAQ as a benchmark to evaluate objective audio quality metrics in their ability to predict subjective scores.
ER  -