This paper investigates how to achieve and perceptually evaluate the benefits of extending head-tracked binaural audio from three-degrees-of-freedom (3DoF) to six-degrees-of-freedom (6DoF) for digital piano players. Building on previous 3DoF research that tracked only rotational head movements, this study evaluates a 6DoF system that captures both rotational and translational movements during digital piano performance. A real-time HRTF-based binaural rendering system was developed using a custom plugin integrated with face-tracking technology in a Max/MSPDAW environment to process 6DoF movement data alongside MIDI input from the digital piano. Perceptual evaluation comparing 3DoF and 6DoF tracking modes across five attributes: Dynamic Spatial Realism, Spatial Clarity, Source Stability, Envelopment, and Preference demonstrated significant improvements for 6DoF tracking in four of five attributes. These findings validate the importance of capturing pianists` natural translational head movements and demonstrate that 6DoF head-tracked binaural audio offers enhanced realism and immersion that more closely approximates the acoustic piano experience.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=23087
(24648KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
