Comparing the Effect of Audio Coding Artifacts on Objective Quality Measures and on Subjective Ratings

Torcoli M, Dick S. Comparing the Effect of Audio Coding Artifacts on Objective Quality Measures and on Subjective Ratings. In: AES Convention 144. Audio Engineering Society; 2018. Paper 9951. Available from: https://aes.org/publications/elibrary-page/?id=19468

@inproceedings{Torcoli2018_19468,
  author = {Torcoli, Matteo and Dick, Sascha},
  title = {{Comparing the Effect of Audio Coding Artifacts on Objective Quality Measures and on Subjective Ratings}},
  booktitle = {AES Convention 144},
  note = {Paper 9951},
  year = {2018},
  month = may,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=19468}
}

TY  - CPAPER
TI  - Comparing the Effect of Audio Coding Artifacts on Objective Quality Measures and on Subjective Ratings
AU  - Torcoli, Matteo
AU  - Dick, Sascha
T2  - AES Convention 144
M1  - Paper 9951
PY  - 2018
DA  - 2018/05/06
UR  - https://aes.org/publications/elibrary-page/?id=19468
PB  - Audio Engineering Society
LA  - en
AB  - A recent work presented the subjective ratings from an extensive perceptual quality evaluation of audio signals, where isolated coding artifact types of varying strength were introduced. We use these ratings as perceptual reference for studying the performance of 11 well-known tools for objective audio quality evaluation: PEAQ, PEMO-Q, ViSQOLAudio, HAAQI, PESQ, POLQA, fwSNRseg, dLLR, LKR, BSSEval, and PEASS. Some tools achieve high correlation with subjective data for specific artifact types (Pearson's r > 0.90, Kendall's t > 0.70), corroborating their value during the development of a specific algorithm. Still, the performance of each tool varies depending on the artifact type and no tool reliably assesses artifacts from parametric audio coding. Nowadays, perceptual evaluation remains irreplaceable, especially when comparing different coding schemes introducing different artifacts.
ER  -