Home / Publications / E-library page
Only AES members and Institutional Journal Subscribers can download
Although predictive models are widely used to predict the results of listening tests, there are currently no standardized statistical metrics for assessing the rank order. Commonly used rank-order metrics do not consider the variance of the listening test data. This paper proposes two novel metrics for assessing rank order with respect to variance by adapting Spearman’s Rho and Kendall’s Tau and assesses the performance of these metrics against actual listening test data with standardized prediction models.
Author (s): Pearce, Andy; Isabelle, Scott; Francois, Holly; Oh, Eunmi
Affiliation:
University of Surrey, Guildford, UK; Amazon, Santa Clara, CA, USA; Samsung Electronics, Staines, UK; Samsung Electronics, Seoul, Republic of Korea
(See document for exact affiliation information.)
Publication Date:
2019-01-06
Import into BibTeX
Permalink: https://aes2.org/publications/elibrary-page/?id=19887
(494KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
Pearce, Andy; Isabelle, Scott; Francois, Holly; Oh, Eunmi; 2019; Methods of Assessing the Rank Order of Prediction Models with Respect to Variance of Listening Test Ratings [PDF]; University of Surrey, Guildford, UK; Amazon, Santa Clara, CA, USA; Samsung Electronics, Staines, UK; Samsung Electronics, Seoul, Republic of Korea; Paper ; Available from: https://aes2.org/publications/elibrary-page/?id=19887
Pearce, Andy; Isabelle, Scott; Francois, Holly; Oh, Eunmi; Methods of Assessing the Rank Order of Prediction Models with Respect to Variance of Listening Test Ratings [PDF]; University of Surrey, Guildford, UK; Amazon, Santa Clara, CA, USA; Samsung Electronics, Staines, UK; Samsung Electronics, Seoul, Republic of Korea; Paper ; 2019 Available: https://aes2.org/publications/elibrary-page/?id=19887
@article{pearce2019methods,
author={pearce andy and isabelle scott and francois holly and oh eunmi},
journal={journal of the audio engineering society},
title={methods of assessing the rank order of prediction models with respect to variance of listening test ratings},
year={2019},
volume={67},
issue={1/2},
pages={60-68},
month={january},}
TY – paper
TI – Methods of Assessing the Rank Order of Prediction Models with Respect to Variance of Listening Test Ratings
SP – 60 EP – 68
AU – Pearce, Andy
AU – Isabelle, Scott
AU – Francois, Holly
AU – Oh, Eunmi
PY – 2019
JO – Journal of the Audio Engineering Society
VO – 67
IS – 1/2
Y1 – January 2019