Home / Publications / E-library page
Only AES members and Institutional Journal Subscribers can download
The development of intelligent music production tools has been of growing interest in recent years. Deep learning approaches have been shown as being a highly effective method for approximating individual audio effects. In this work, we propose an end-to-end deep neural network based on the Wave-U-Net to perform automatic mixing of drums. We follow an end-to-end approach where raw audio from the individual drum recordings is the input of the system and the waveform of the stereo mix is the output. We compare the system to existing machine learning approaches to intelligent drum mixing. Through a subjective listening test we explore the performance of these systems when processing various types of drum mixes. We report that the mixes generated by our model are virtually indistinguishable from professional human mixes while also outperforming previous intelligent mixing approaches.
Author (s): Martínez Ramírez, Marco A.; Stoller, Daniel; Moffat, David
Affiliation:
Centre for Digital Music, Queen Mary University of London, London, United Kingdom; Centre for Digital Music, Queen Mary University of London, London, United Kingdom; Interdisciplinary Center for Computer Music Research, University of Plymouth, Plymouth, United Kingdom
(See document for exact affiliation information.)
Publication Date:
2021-03-06
Import into BibTeX
Permalink: https://aes2.org/publications/elibrary-page/?id=21023
(520KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
Martínez Ramírez, Marco A.; Stoller, Daniel; Moffat, David; 2021; A Deep Learning Approach to Intelligent Drum Mixing With the Wave-U-Net [PDF]; Centre for Digital Music, Queen Mary University of London, London, United Kingdom; Centre for Digital Music, Queen Mary University of London, London, United Kingdom; Interdisciplinary Center for Computer Music Research, University of Plymouth, Plymouth, United Kingdom; Paper ; Available from: https://aes2.org/publications/elibrary-page/?id=21023
Martínez Ramírez, Marco A.; Stoller, Daniel; Moffat, David; A Deep Learning Approach to Intelligent Drum Mixing With the Wave-U-Net [PDF]; Centre for Digital Music, Queen Mary University of London, London, United Kingdom; Centre for Digital Music, Queen Mary University of London, London, United Kingdom; Interdisciplinary Center for Computer Music Research, University of Plymouth, Plymouth, United Kingdom; Paper ; 2021 Available: https://aes2.org/publications/elibrary-page/?id=21023
@article{martínez2021a,
author={martínez ramírez marco a. and stoller daniel and moffat david},
journal={journal of the audio engineering society},
title={a deep learning approach to intelligent drum mixing with the wave-u-net},
year={2021},
volume={69},
issue={3},
pages={142-151},
month={march},}