We present a toolbox for multi-stimulus perceptual evaluation of audio samples. Different from MUSHRA (typical for evaluating audio codecs), the audio samples under test are represented by sliders on a single axis, encouraging careful rating, relative to adjacent samples, where both the reference and anchor are optional. Intended as a more flexible, versatile test design environment, subjects can rate the same samples on di fferent scales simultaneously, with separate comment boxes for each sample, an arbitrary rating scale, and various randomization options. Other tools include a pairwise evaluation tool and a loudness equalization stage. We discuss some notable experiences and considerations based on various studies where these tools were used. We have found this test design to be highly effective when perceptually evaluating qualities pertaining to music and audio production.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=17160
(288KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
