You are currently logged in as an
Institutional Subscriber.
If you would like to logout,
please click on the button below.
Home / Publications / E-library page
Only AES members and Institutional Journal Subscribers can download
The Open Dataset of Audio Quality (ODAQ) was recently introduced to address the scarcity of openly available audio datasets with corresponding subjective quality scores. The dataset, released under permissive licenses, comprises audio material processed using six different signal processing methods operating at five quality levels, along with corresponding subjective test results. To expand the dataset, we provided listener training to university students to conduct further subjective tests and obtained results consistent with previous expert listeners. We also showed how different training approaches affect the use of absolute scales and anchors. The expanded dataset now comprises results from three international laboratories providing a total of 42 listeners and 10080 subjective scores. This paper provides the details of the expansion and an in-depth analysis. As part of this analysis, we initiate the use of ODAQ as a benchmark to evaluate objective audio quality metrics in their ability to predict subjective scores.
Author (s): Dick, Sascha;
Tompson, Christoph;
Wu, Chih-Wei;
Torcoli, Matteo;
Delgado, Pablo;
Williams, Phillip A.;
Habets, Emanuël;
Affiliation:
Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Ball State University, Muncie, USA; Netflix, Inc., Los Gatos, USA; Netflix, Inc., Los Gatos, USA
(See document for exact affiliation information.)
AES Convention: 157
Paper Number:263
Publication Date:
2024-09-27
DOI:
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.

Dick, Sascha; Tompson, Christoph; Wu, Chih-Wei; Torcoli, Matteo; Delgado, Pablo; Williams, Phillip A.; Habets, Emanuël; 2024; Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality [PDF]; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Ball State University, Muncie, USA; Netflix, Inc., Los Gatos, USA; Netflix, Inc., Los Gatos, USA; Paper 263; Available from: https://aes.org/publications/elibrary-page/?id=22721
Dick, Sascha; Tompson, Christoph; Wu, Chih-Wei; Torcoli, Matteo; Delgado, Pablo; Williams, Phillip A.; Habets, Emanuël; Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality [PDF]; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Ball State University, Muncie, USA; Netflix, Inc., Los Gatos, USA; Netflix, Inc., Los Gatos, USA; Paper 263; 2024 Available: https://aes.org/publications/elibrary-page/?id=22721
@inproceedings{Dick2024expanding,
title={{Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality}},
author={Dick, Sascha and Tompson, Christoph and Wu, Chih-Wei and Torcoli, Matteo and Delgado, Pablo and Williams, Phillip A. and Habets, Emanuël},
year={2024},
month={may},
booktitle={Journal of the Audio Engineering Society},
publisher={},
number={263},
organization={AES},
}
TY – paper
TI – Expanding and Analyzing ODAQ - The Open Dataset of Audio Quality
AU – Dick, Sascha
AU – Tompson, Christoph
AU – Wu, Chih-Wei
AU – Torcoli, Matteo
AU – Delgado, Pablo
AU – Williams, Phillip A.
AU – Habets, Emanuël
PY – 2024
JO – Journal of the Audio Engineering Society
VL – 263
Y1 – May 2024
Notifications