Several studies have used deep learning methods to create digital twins of amps, speakers, and effects pedals. This paper presents a novel method for creating a digital twin of a physical loudspeaker with stereo output. Two neural network architectures are considered: a Recurrent Neural Network (RNN) and a WaveNet-style Convolutional Neural Network (CNN). The models were tested on two datasets containing speech and music, respectively. The method of recording and preprocessing the target audio data addresses the challenge of lacking a direct output line to digitize the effect of nonlinear circuits. Both model architectures successfully create a digital twin of the loudspeaker with no direct output line and stereo audio. The RNN model achieved the best result on the music dataset, while the WaveNet model achieved the best result on the speech dataset.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=22049
(26829KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
