Opens in a new tab

AES E-Library

← Back to search

Express Paper

A Hybrid Time and Time-frequency Domain Implicit Neural Representation for Acoustic Fields

Authors: Ge, Zhongshu; Li, Liang; Qu, Tianshu

Express Paper · Paper 196 · June 2024

Abstract

Creating an immersive scene relies on detailed spatial sound. Traditional methods, using probe points for impulse responses, need lots of storage. Meanwhile, geometry-based simulations struggle with complex sound effects. Now, neural-based methods are improving accuracy and slashing storage needs. In our study, we propose a hybrid time and time-frequency domain strategy to model the time series of Ambisonic acoustic fields. The networks excels in generating high-fidelity time-domain impulse responses at arbitrary source-recceiver positions by learning a continuous representation of the acoustic field. Our experimental results demonstrate that the proposed model outperforms baseline methods in various aspects of sound representation and rendering for different source-recceiver positions.

Details

AES Convention
156
Paper number
196
Publication date
June 6, 2024
Affiliation
National Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China, and School of Psychology, Peking University, Beijing, China; School of Psychology, Peking University, Beijing, China; School of Artificial Intelligence, Peking University, Beijing, China (See document for exact affiliation information.)
Type
Express Paper