While sound transmits linguistic and musical information through its temporal variations, its spatial distribution encodes vital information related to three-dimensional perception and spatial audio representation. However, since sound is invisible to the human eye, grasping its spatial characteristics is challenging. This paper proposes a fully optical visualization method for spatial audio waves alongside the 3D geometry and texture of sound sources. The proposed method involves reconstructing a three-dimensional sound field from a high-speed video of projected sound fields measured using optical interferometry. The continuous rotation of the sound source enables the reconstruction of a volumetric sound field from a single video with a spatial resolution finer than 1 mm. The 3D surfaces and textures of the sound source are constructed from an ordinary video using a neural radiance field-based mesh generation technique. The volumetric sound field and 3D objects are integrated and visualized simultaneously in a 3D space, allowing us to visually ascertain where and how the sound is generated and propagates. The proposed method is demonstrated with three examples: sound radiation from a loudspeaker, a smartphone, and an ultrasonic transducer array.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=23080
(8086KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
