This work presents a method for 6DoF binaural rendering from multi-point first- or higher-order Ambisonic (FOA/HOA) recordings for the case when the listener is outside of the area covered by the microphones. This work builds on top of a previously presented method for 6DoF binaural rendering when the listener is inside the area covered by the microphones [1]. The method measures spatial parameters in the time-frequency domain that summarize the scene at the microphone positions. It then estimates the same parameters at the listener position through spatial interpolation of the measured ones. In this work, the spatial parameter calculation is modified to accommodate situations where spatial interpolation is not possible as described in the previous work. A real-time 6DoF listening preference test demonstrates that the proposed method provides plausible rendering when the listener is outside of the microphone area. This work is related to the upcoming MPEG-I immersive audio standard (ISO/IEC 23090-4) which is defining 6DoF immersive audio technology for AR and VR scenarios.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=22662
(517KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
