Automatic Cloning of Recorded Sounds by Software Synthesizers

Heise S, Hlatky M, Loviscach J. Automatic Cloning of Recorded Sounds by Software Synthesizers. In: AES Convention 127. Audio Engineering Society; 2009. Paper 7858. Available from: https://aes.org/publications/elibrary-page/?id=15053

@inproceedings{Heise2009_15053,
  author = {Heise, Sebastian and Hlatky, Michael and Loviscach, Jörn},
  title = {{Automatic Cloning of Recorded Sounds by Software Synthesizers}},
  booktitle = {AES Convention 127},
  note = {Paper 7858},
  year = {2009},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=15053}
}

TY  - CPAPER
TI  - Automatic Cloning of Recorded Sounds by Software Synthesizers
AU  - Heise, Sebastian
AU  - Hlatky, Michael
AU  - Loviscach, Jörn
T2  - AES Convention 127
M1  - Paper 7858
PY  - 2009
DA  - 2009/10/06
UR  - https://aes.org/publications/elibrary-page/?id=15053
PB  - Audio Engineering Society
LA  - en
AB  - Any audio recording can be turned into a digital musical instrument by feeding it into an audio sampler. However, it is difficult to edit such a sound in musical terms or even to control it in real time with musical expression. Even the application of a more sophisticated synthesis method will show little change. Many composers of electronic music appreciate the direct and clear access to sound parameters that a traditional analog synthesizer offers. Is it possible to automatically generate a synthesizer setting that approximates a given audio recording and thus clone a given sound to be controlled with the standard functions of the particular synthesizer employed? Even though this problem seems highly complex, we demonstrate that its solution becomes feasible with computer systems available today. We compare sounds on the basis of acoustic features known from Music Information Retrieval and apply a specialized optimization strategy to adjust the settings of VST instruments. This process is sped up using multi-core processors and networked computers.
ER  -