Potential Biases in MUSHRA Listening Tests

Zielinski S, Hardisty P, Hummersone C, Rumsey F. Potential Biases in MUSHRA Listening Tests. In: AES Convention 123. Audio Engineering Society; 2007. Paper 7179. Available from: https://aes.org/publications/elibrary-page/?id=14237

@inproceedings{Zielinski2007_14237,
  author = {Zielinski, Slawomir and Hardisty, Philip and Hummersone, Christopher and Rumsey, Francis},
  title = {{Potential Biases in MUSHRA Listening Tests}},
  booktitle = {AES Convention 123},
  note = {Paper 7179},
  year = {2007},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=14237}
}

TY  - CPAPER
TI  - Potential Biases in MUSHRA Listening Tests
AU  - Zielinski, Slawomir
AU  - Hardisty, Philip
AU  - Hummersone, Christopher
AU  - Rumsey, Francis
T2  - AES Convention 123
M1  - Paper 7179
PY  - 2007
DA  - 2007/10/06
UR  - https://aes.org/publications/elibrary-page/?id=14237
PB  - Audio Engineering Society
LA  - en
AB  - The method described in the ITU-R BS.1534-1 standard, commonly known as MUSHRA (MUltiple Stimulus with Hidden Reference and Anchors), is widely used for the evaluation of systems exhibiting intermediate quality levels, in particular low-bit rate codecs. This paper demonstrates that this method, despite its popularity, is not immune to biases. In two different experiments designed to investigate potential biases in the MUSHRA test, systematic discrepancies in the results were observed with a magnitude up to 22%. The data indicates that these discrepancies could be attributed to the stimulus spacing and range equalizing biases.
ER  -