Synthesis of Wind Instruments and Their Blowing Noise Using a LSTM Time Varying Source Filter Model

Chen JY, Yang HC, Su WY. Synthesis of Wind Instruments and Their Blowing Noise Using a LSTM Time Varying Source Filter Model. In: AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020). Audio Engineering Society; 2020. Paper 10478. Available from: https://aes.org/publications/elibrary-page/?id=21155

@inproceedings{Chen2020_21155,
  author = {Chen, Ju- Yen and Yang, Hung-Chih and Su, Wen-Yu},
  title = {{Synthesis of Wind Instruments and Their Blowing Noise Using a LSTM Time Varying Source Filter Model}},
  booktitle = {AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020)},
  note = {Paper 10478},
  year = {2020},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21155}
}

TY  - CPAPER
TI  - Synthesis of Wind Instruments and Their Blowing Noise Using a LSTM Time Varying Source Filter Model
AU  - Chen, Ju- Yen
AU  - Yang, Hung-Chih
AU  - Su, Wen-Yu
T2  - AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020)
M1  - Paper 10478
PY  - 2020
DA  - 2020/08/06
UR  - https://aes.org/publications/elibrary-page/?id=21155
PB  - Audio Engineering Society
LA  - en
AB  - Digital Waveguide Filters have been applied to synthesis of wind instruments for years. To design the filter coefficients to synthesize the timbre of a particular instrument usually takes lots of time and effort. A source filter model combined with a long short-term memory(LSTM) recurrent neural network for the synthesis of violin has been successful in this respect, but it lacks the synthesis of the noise part that is important for any playing wind instruments. In this paper, we adopt the noise synthesis method of DWF and apply it to the LSTM based source filter model to take the advantages of both methods. The French horn tones recorded in the Real World Computing(RWC) database are used to demonstrate the work. The synthesis tone sounds close to the original tone. Sound files are provided. The proposed method can be efficiently implemented as a VST plugin.
ER  -