Type 1 and Type 2 Errors in the Statistical Analysis of Listening Tests

Leventhal L. Type 1 and Type 2 Errors in the Statistical Analysis of Listening Tests. J Audio Eng Soc. 1986;34(6):437-453. Available from: https://aes.org/publications/elibrary-page/?id=5265

@article{Leventhal1986_5265,
  author = {Leventhal, Les},
  title = {{Type 1 and Type 2 Errors in the Statistical Analysis of Listening Tests}},
  journal = {Journal of the Audio Engineering Society},
  volume = {34},
  number = {6},
  pages = {437--453},
  year = {1986},
  month = jun,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=5265}
}

TY  - JOUR
TI  - Type 1 and Type 2 Errors in the Statistical Analysis of Listening Tests
AU  - Leventhal, Les
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 34
IS  - 6
SP  - 437
EP  - 453
PY  - 1986
DA  - 1986/06/06
UR  - https://aes.org/publications/elibrary-page/?id=5265
PB  - Audio Engineering Society
LA  - en
AB  - When the conventional 0.05 significance level is used to analyze listening test data, employing a small number of trials or listeners can produce an unexpectedly high risk of concluding that audible differences are inaudible (type 2 error). The risk can be both large absolutely and large relative to the risk of concluding that inaudible differences are audible (type 2 error). this constitutes systematic bias against those who believe that differences are audible between well-designed electronic components that are spectrally equated and not overdriven. A statistical table is introduced that enables readers to look up type 1 and type 2 error risks without calculation. Ways to manipulate the risks are discussed, a quantitative measure of a listening test's fairness is introduced, and implications for reviewers of the listening test literature are discussed.
ER  -