Difficulties in following speech on TV due to loud background sounds are a common issue in broadcasting. Object-based audio (OBA) systems like MPEG-H Audio can solve this problem by providing a personalized speech level. Recently, international broadcasters have employed dialogue enhancement (DE) together with OBA, providing customization and improved accessibility to their audiences, e.g., during the football World Cup 2022. To also add customizable dialogues to material produced without OBA, deep neural networks (DNNs) can be applied to separate dialogues from the music and effects of the final audio mix. One of the technologies used for this is MPEG-H Dialog+, which has recently been adopted for the new “Clear Speech” service of the on-demand platform of the German public broadcaster ARD. This paper reviews the current state of DE, detailing real-world adoptions, with particular focus on the MPEG-H Audio system. The intention is to provide an up-to-date overview of successful implementations of DE solutions into production workflows as an example for further adoptions and developments.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=22109
(1502KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
