You are currently logged in as an
Institutional Subscriber.
If you would like to logout,
please click on the button below.
Home / Publications / E-library page
Only AES members and Institutional Journal Subscribers can download
Reverse engineering of music mixes aims to uncover how dry source signals are processed and combined to produce a final mix. In this paper, prior works are extended to reflect the compositional nature of mixing and search for a graph of audio processors. First, a mixing console is constructed, applying all available processors to every track and subgroup. With differentiable processor implementations, their parameters are optimized with gradient descent. Next, the process of removing negligible processors and fine-tuning the remaining ones is repeated. This way, the quality of the full mixing console can be preserved while removing approximately two-thirds of the processors. The proposed method can be used not only to analyze individual music mixes but also to collect large-scale graph data for downstream tasks such as automatic mixing. Especially for the latter purpose, efficient implementation of the search is crucial. To this end, an efficient batch-processing method that computes multiple processors in parallel is presented. Also, the “dry/wet” parameter of each processor is exploited to accelerate the search. Extensive quantitative and qualitative analyses are conducted to evaluate the proposed method’s performance, behavior, and computational cost.
Author (s): Lee, Sungho; Martínez-Ramírez, Marco A.; Liao, Wei-Hsiang; Uhlich, Stefan; Fabbro, Giorgio; Lee, Kyogu; Mitsufuji, Yuki
Affiliation:
Department of Information and Intelligence, Seoul National University, Seoul, South Korea; Department of Information and Intelligence, Seoul National University, Seoul, South Korea; Sony AI, Tokyo, Japan; Sony AI, Tokyo, Japan; Sony AI, Tokyo, Japan; Sony Europe B.V., Stuttgart, Germany; Sony Europe B.V., Stuttgart, Germany; Sony Group Corporation, Tokyo, Japan
(See document for exact affiliation information.)
Publication Date:
2025-06-04
Import into BibTeX
Permalink: https://aes2.org/publications/elibrary-page/?id=22917
(1975KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
Lee, Sungho; Martínez-Ramírez, Marco A.; Liao, Wei-Hsiang; Uhlich, Stefan; Fabbro, Giorgio; Lee, Kyogu; Mitsufuji, Yuki; 2025; Reverse Engineering of Music Mixing Graphs With Differentiable Processors and Iterative Pruning [PDF]; Department of Information and Intelligence, Seoul National University, Seoul, South Korea; Department of Information and Intelligence, Seoul National University, Seoul, South Korea; Sony AI, Tokyo, Japan; Sony AI, Tokyo, Japan; Sony AI, Tokyo, Japan; Sony Europe B.V., Stuttgart, Germany; Sony Europe B.V., Stuttgart, Germany; Sony Group Corporation, Tokyo, Japan; Paper ; Available from: https://aes2.org/publications/elibrary-page/?id=22917
Lee, Sungho; Martínez-Ramírez, Marco A.; Liao, Wei-Hsiang; Uhlich, Stefan; Fabbro, Giorgio; Lee, Kyogu; Mitsufuji, Yuki; Reverse Engineering of Music Mixing Graphs With Differentiable Processors and Iterative Pruning [PDF]; Department of Information and Intelligence, Seoul National University, Seoul, South Korea; Department of Information and Intelligence, Seoul National University, Seoul, South Korea; Sony AI, Tokyo, Japan; Sony AI, Tokyo, Japan; Sony AI, Tokyo, Japan; Sony Europe B.V., Stuttgart, Germany; Sony Europe B.V., Stuttgart, Germany; Sony Group Corporation, Tokyo, Japan; Paper ; 2025 Available: https://aes2.org/publications/elibrary-page/?id=22917
@article{lee2025reverse,
author={lee sungho and martínez-ramírez marco a. and liao wei-hsiang and uhlich stefan and fabbro giorgio and lee kyogu and mitsufuji yuki},
journal={journal of the audio engineering society},
title={reverse engineering of music mixing graphs with differentiable processors and iterative pruning},
year={2025},
volume={73},
issue={6},
pages={344-365},
month={june},}
TY – paper
TI – Reverse Engineering of Music Mixing Graphs With Differentiable Processors and Iterative Pruning
SP – 344 EP – 365
AU – Lee, Sungho
AU – Martínez-Ramírez, Marco A.
AU – Liao, Wei-Hsiang
AU – Uhlich, Stefan
AU – Fabbro, Giorgio
AU – Lee, Kyogu
AU – Mitsufuji, Yuki
PY – 2025
JO – Journal of the Audio Engineering Society
VO – 73
IS – 6
Y1 – June 2025