Opens in a new tab

AES E-Library

← Back to search

Journal Article Open Access

Audio Signal Processing in the Artificial Intelligence Era: Challenges and Directions

Authors: Steinmetz, Christian J.; Uhle, Christian; Everardo, Flavio; Mitcheltree, Christopher; McElveen, J. Keith; Jot, Jean-Marc; Wichern, Gordon

Journal of the Audio Engineering Society · Volume 73 · Issue 7/8 · pp. 406–428 · July 2025

Abstract

Artificial intelligence (AI) has seen significant advancement in recent years, leading to increasing interest in integrating these techniques to solve both existing and emerging problems in audio engineering. In this paper, the authors investigate current trends in the application of AI for audio engineering, outlining open problems and applications in the research field. The paper begins by providing an overview of AI-based algorithm development in the context of audio, discussing problem selection and taxonomy. Next, human-centric AI challenges and how they relate to audio engineering are explored, including ethics, trustworthiness, explainability, and interaction, emphasizing the need for ethically sound and human-centered AI systems. Subsequently, technical challenges that arise when applying modern AI techniques to audio are examined, including robust generalization, audio quality, high sample rates, and real-time processing with low latency. Finally, the authors outline applications of AI in audio engineering, covering the development of machine learning–powered audio effects, synthesizers, automated mixing systems, and spatial audio, speech enhancement, dialog separation, and music generation. Emphasized are the need for a balanced approach that integrates humancentric concerns with technological advancements, advocating for responsible and effective application of AI.

Details

Publication
Journal of the Audio Engineering Society
Volume
73
Issue
7/8
Pages
406–428
Publication date
July 7, 2025
Affiliation
Centre for Digital Music, Queen Mary University of London, London, UK; Centre for Digital Music, Queen Mary University of London, London, UK; Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; International Audio Laboratories Erlangen, Erlangen, Germany; Tecnológico de Monterrey Campus Puebla, Puebla, Mexico; Wave Sciences, Charleston, SC; Virtuel Works, LLC, Aptos, CA; Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA (See document for exact affiliation information.)
Type
Journal Article