Compressing Neural Network Models of Audio Distortion Effects Using Knowledge Distillation Techniques

Simionato R, Tidemann A. Compressing Neural Network Models of Audio Distortion Effects Using Knowledge Distillation Techniques. In: 2025 AES International Conference on Artificial Intelligence and Machine Learning for Audio. Audio Engineering Society; 2025.pp. 12:1-10. Available from: https://aes.org/publications/elibrary-page/?id=23001

@inproceedings{Simionato2025_23001,
  author = {Simionato, Riccardo and Tidemann, Aleksander},
  title = {{Compressing Neural Network Models of Audio Distortion Effects Using Knowledge Distillation Techniques}},
  booktitle = {2025 AES International Conference on Artificial Intelligence and Machine Learning for Audio},
  pages = {12:1-10},
  year = {2025},
  month = sep,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=23001}
}

TY  - CPAPER
TI  - Compressing Neural Network Models of Audio Distortion Effects Using Knowledge Distillation Techniques
AU  - Simionato, Riccardo
AU  - Tidemann, Aleksander
T2  - 2025 AES International Conference on Artificial Intelligence and Machine Learning for Audio
SP  - 1
EP  - 10
M1  - Paper 12
PY  - 2025
DA  - 2025/09/02
UR  - https://aes.org/publications/elibrary-page/?id=23001
PB  - Audio Engineering Society
LA  - en
AB  - Neural networks have proven to be effective for modeling analog audio effects using a black-box approach. However, few can guarantee lightweight solutions suitable for real-time environments where the models must run concurrently on consumer-grade equipment. This paper explores knowledge distillation techniques for compressing recurrent neural network models for audio distortion effects, aiming to produce computationally efficient solutions with high accuracy that maintain compact model size. In particular, we consider an audio-to-audio LSTM architecture for regression tasks where small networks are trained to mimic the internal representations of larger networks, known as feature-based knowledge distillation. The evaluation was conducted on three different audio distortion effect datasets with experiments on both parametric and non-parametric data. The results show that distilled models are more accurate than non-distilled models with equal parameter size, especially for models that exhibit higher error rates. Furthermore, we observe that smaller complexity gaps between student and teacher models yield greater improvements in non-parametric cases.
ER  -