How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience?

Schinkel-Bielefeld N, Leschanowsky AK. How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience? In: AES Convention 138. Audio Engineering Society; 2015. Paper 9311. Available from: https://aes.org/publications/elibrary-page/?id=17735

@inproceedings{SchinkelBielefeld2015_17735,
  author = {Schinkel-Bielefeld, Nadja and Leschanowsky, Anna Katharina},
  title = {{How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience?}},
  booktitle = {AES Convention 138},
  note = {Paper 9311},
  year = {2015},
  month = may,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=17735}
}

TY  - CPAPER
TI  - How Much Is the Use of a Rating Scale by a Listener Influenced by Anchors and by the Listener's Experience?
AU  - Schinkel-Bielefeld, Nadja
AU  - Leschanowsky, Anna Katharina
T2  - AES Convention 138
M1  - Paper 9311
PY  - 2015
DA  - 2015/05/06
UR  - https://aes.org/publications/elibrary-page/?id=17735
PB  - Audio Engineering Society
LA  - en
AB  - It has been postulated that anchors in multi-stimulus listening tests for audio quality evaluation should have an item-independent quality, as listeners will likely shift their rating scale if the quality of the anchor varies. However, expert listeners have a very stable internal rating scale, which can be seen from the repeatability of their results when performing the same test multiple times. So they may stick to their usual scale even if the anchor varies. We find that listeners do not shift their rating scale by the full amount the anchor is shifted but only up to 60% of that. Nevertheless this makes quantitative comparisons between different test results difficult even if the anchor varies only by 5 Mushra points.
ER  -