When constructing virtual realities, the task of the sound designer is usually to create a suitable immersive sound scene to fit the situation in the virtual world. This paper presented a real-time method (spatially modified synthesis, i.e., SpaMoS) for modifying the reproduction of a spatial sound recording based on the listener movement in the virtual reality to provide the perception of believable movement inside the recorded sound scene. The method decomposes the omnidirectional signal of a B-format recording into granular virtual omnidirectional sources and then places them on an arbitrary surface defining a convex hull. The placement is based on an energetic analysis performed on the B-format signal. This synthesis is complemented with a separate diffuse synthesis that ideally reproduces the ambience and reverberation from the original signal. Listening experiments show that the method is plausible and the quality of the method is very good when the listener is inside the specific cylinder-shaped surface.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=17840
(278KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
