Machine Learning Multitrack Gain Mixing of Drums

Moffat D, Sandler M. Machine Learning Multitrack Gain Mixing of Drums. In: AES Convention 147. Audio Engineering Society; 2019. Paper 527. Available from: https://aes.org/publications/elibrary-page/?id=20550

@inproceedings{Moffat2019_20550,
  author = {Moffat, Dave and Sandler, Mark},
  title = {{Machine Learning Multitrack Gain Mixing of Drums}},
  booktitle = {AES Convention 147},
  note = {Paper 527},
  year = {2019},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=20550}
}

TY  - CPAPER
TI  - Machine Learning Multitrack Gain Mixing of Drums
AU  - Moffat, Dave
AU  - Sandler, Mark
T2  - AES Convention 147
M1  - Paper 527
PY  - 2019
DA  - 2019/10/06
UR  - https://aes.org/publications/elibrary-page/?id=20550
PB  - Audio Engineering Society
LA  - en
AB  - There is a body of work in the field of intelligent music production covering a range of specific audio effects. However, there is a distinct lack of any purely machine learning approaches to automatic mixing. This could be due to a lack of suitable data. This paper presents an approach to used human produced audio mixes, along with their source multitrack, to produce the set of mix parameters. The focus will be entirely on the gain mixing of audio drum tracks. Using existing reverse engineering of music production gain parameters, a target mix gain parameter is identified, and these results are fed into a number of machine learning algorithms, along with audio feature vectors of each audio track. This allow for a machine learning prediction approach to audio gain mixing. A random forest approach is taken to perform a multiple output prediction. The prediction results of the random forest approach are then compared to a number of other published automatic gain mixing approaches. The results demonstrate that the random forest gain mixing approach performs similarly to that of a human engineer and outperforms the existing gain mixing approaches.
ER  -