In this paper, we investigate how a repeated knockout tournament design could be applied to psychoacoustic experimentation. By simulating tournaments consisting of pairwise comparisons between players (cf. sound samples), we investigate the statistics of the outcomes of knockout (KO) and round-robin (RR) tournaments under various realistic assumptions regarding the pairwise winning probabilities. We find that often the KO design can identify the top-ranking player in fewer total games but with similar accuracy as the RR. We suggest that knockout tournament designs can be beneficial especially when the aim is to narrow down on a small subset of best samples among a large pool of initial alternatives.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=22315
(1367KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
