AES E-Library

← Back to search

Journal Article

Type 1 and Type 2 Errors in the Statistical Analysis of Listening Tests

Authors: Leventhal, Les

Journal of the Audio Engineering Society · Volume 34 · Issue 6 · pp. 437–453 · June 1986

Abstract

When the conventional 0.05 significance level is used to analyze listening test data, employing a small number of trials or listeners can produce an unexpectedly high risk of concluding that audible differences are inaudible (type 2 error). The risk can be both large absolutely and large relative to the risk of concluding that inaudible differences are audible (type 2 error). this constitutes systematic bias against those who believe that differences are audible between well-designed electronic components that are spectrally equated and not overdriven. A statistical table is introduced that enables readers to look up type 1 and type 2 error risks without calculation. Ways to manipulate the risks are discussed, a quantitative measure of a listening test's fairness is introduced, and implications for reviewers of the listening test literature are discussed.

Details

Publication
Journal of the Audio Engineering Society
Volume
34
Issue
6
Pages
437–453
Publication date
June 6, 1986
Affiliation
Department of Psychology, University of Manitoba, Winnipeg, Man. R3T 2N2, Canada (See document for exact affiliation information.)
Type
Journal Article

Save to list