Conductors face challenges when conducting the orchestra with headphones to synchronize with a soundtrack or a click track. We sent a survey to 12 international conductors to identify and classify those challenges. They primarily reported on balance issues, aggressive click tracks, and the difficulty of hearing the acoustic sound of the orchestra, leading 70% of them to remove one ear out of the headphones. A solution using augmented reality monitoring through binaural rendering and head tracking was tested in various situations and showed that it could successfully reproduce the acoustic sound of the orchestra into the headphones. Another perceptual experiment evaluated the potential of realism of this solution when merging two binaural auditory scenes recorded in the same acoustic space together. Results encourage us to further develop immersive monitoring systems for conductors, with the soundtrack integrated in the real acoustic space.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=18598
(2114KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
