Convention Paper
GLS - A generalised listener selection procedure
AES Convention 110 · Paper 5405 · May 2001
Abstract
The need to perform subjective evaluations of audio is forever present. Such techniques are know to be inefficient and prone to unreliability. This can be partially overcome by using so-called expert as opposed to naive listeners. Expertise is addressed in some depth to clarify its meaning and to illustrate the benefits in terms of reliability and repeatability of listening tests. The generalized listener selection (GLS) procedure is presented for establishing permanent expert listening panels for a wide range of subjective tests. The method allows for the rapid selection and assessment of listeners based upon a number of criteria. Correct sampling of the population is achieved by an assessment of on-line questionnaires, followed by an audiometric evaluation. The last stage of the GLS procedure consists of three listening tests, identical in structure, designed to evaluate the discrimination skills and reliability of subjects. Means for the assessment of both intrarater reliability and interrater agreement are presented.
