Opens in a new tab

AES E-Library

← Back to search

Convention Paper

A Systematic Literature Review on Inverse Synthesis and Sound Matching

Authors: Gaw˛ecki, Bruno; Łukasik, Ewa

Convention Paper · Paper 10306 · May 2026

Abstract

This paper presents a systematic literature review on inverse synthesis and sound matching, which focus on predicting synthesizer parameters to recreate a target audio waveform. Automating this process via machine learning is impeded by non-linear parameter mapping, non-differentiable engines, data scarcity, and metric misalignment. Existing approaches are categorized into non-differentiable synthesizer methods, utilizing evolutionary algorithms
and deep learning, incorporating techniques to bypass gradient limitations such as neural proxies or generative models. In contrast, differentiable synthesizer methods, enable the integration of audio loss functions into training pipelines via custom signal processing environments. The analysis identifies a critical reliance on spectral representations for evaluating perceptual similarity, given that parameter based metrics frequently fail to align with human hearing. The findings indicate that while deep learning has reduced inference times, the field lacks a unified
production solution. Future progress requires the establishment of standardized benchmarks to evaluate models, the implementation of novel advancements in generative models not yet applied to this problem, and the development of hybrid architectures to simultaneously address these distinct technical challenges.

Details

AES Convention
160
Paper number
10306
Publication date
May 28, 2026
Session subject
AI and Machine Learning in Audio, Audio Applications and Technologies, Sound Design
Affiliation
Institute of Computing Science, Pozna´n University of Technology; Institute of Computing Science, Pozna´n University of Technology (See document for exact affiliation information.)
Type
Convention Paper