Multi-Criteria Subjective and Objective Evaluation of Audio Source Separation

Emiya V, Vincent E, Harlander N, Hohmann V. Multi-Criteria Subjective and Objective Evaluation of Audio Source Separation. In: AES Conference: 38th International Conference: Sound Quality Evaluation. Audio Engineering Society; 2010. Paper 8-3. Available from: https://aes.org/publications/elibrary-page/?id=15468

@inproceedings{Emiya2010_15468,
  author = {Emiya, Valentin and Vincent, Emmanuel and Harlander, Niklas and Hohmann, Volker},
  title = {{Multi-Criteria Subjective and Objective Evaluation of Audio Source Separation}},
  booktitle = {AES Conference: 38th International Conference: Sound Quality Evaluation},
  note = {Paper 8-3},
  year = {2010},
  month = jun,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=15468}
}

TY  - CPAPER
TI  - Multi-Criteria Subjective and Objective Evaluation of Audio Source Separation
AU  - Emiya, Valentin
AU  - Vincent, Emmanuel
AU  - Harlander, Niklas
AU  - Hohmann, Volker
T2  - AES Conference: 38th International Conference: Sound Quality Evaluation
M1  - Paper 8-3
PY  - 2010
DA  - 2010/06/06
UR  - https://aes.org/publications/elibrary-page/?id=15468
PB  - Audio Engineering Society
LA  - en
AB  - In this paper, we address the problem of assessing the perceived quality of estimated source signals in the context of audio source separation. These signals involve different kinds of distortions depending on the considered separation algorithm, including distortion of the target source, interference from other sources or musical noise artifacts. A new MUSHRA-based subjective test protocol is proposed to assess the perceived quality with respect to each kind of distortion and collect the scores of 20 subjects over 80 sounds. Subsequently, the contribution of each type of distortion to the overall quality is analyzed. We propose a family of objective measures aiming to predict the subjective scores based on a decomposition of the estimation error into several distortion components. We conclude by discussing possible implications of this work in the field of 3D audio quality assessment.
ER  -