Repeated knockout tournaments for efficient screening of the top-ranking sample

Hyvärinen P, Meyer-Kahlen N. Repeated knockout tournaments for efficient screening of the top-ranking sample. In: AES Convention 155. Audio Engineering Society; 2023. Paper 161. Available from: https://aes.org/publications/elibrary-page/?id=22315

@inproceedings{Hyvarinen2023_22315,
  author = {Hyvärinen, Petteri and Meyer-Kahlen, Nils},
  title = {{Repeated knockout tournaments for efficient screening of the top-ranking sample}},
  booktitle = {AES Convention 155},
  note = {Paper 161},
  year = {2023},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22315}
}

TY  - CPAPER
TI  - Repeated knockout tournaments for efficient screening of the top-ranking sample
AU  - Hyvärinen, Petteri
AU  - Meyer-Kahlen, Nils
T2  - AES Convention 155
M1  - Paper 161
PY  - 2023
DA  - 2023/10/06
UR  - https://aes.org/publications/elibrary-page/?id=22315
PB  - Audio Engineering Society
LA  - en
AB  - In this paper, we investigate how a repeated knockout tournament design could be applied to psychoacoustic experimentation. By simulating tournaments consisting of pairwise comparisons between players (cf. sound samples), we investigate the statistics of the outcomes of knockout (KO) and round-robin (RR) tournaments under various realistic assumptions regarding the pairwise winning probabilities. We find that often the KO design can identify the top-ranking player in fewer total games but with similar accuracy as the RR. We suggest that knockout tournament designs can be beneficial especially when the aim is to narrow down on a small subset of best samples among a large pool of initial alternatives.
ER  -