Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Flow-HOA: Generative Joint Optimization for Ambisonics Encoding via Flow Matching

Authors: You, Yuhuan; Qian, Yufan; Qu, Tianshu; Wang, Bin; Lv, Xueyang

Convention Paper · Paper 10293 · May 2026

Abstract

Higher-Order Ambisonics (HOA) encoding from sparse, irregular microphone arrays remains a critical challenge for consumer spatial audio capture in immersive communication and XR. We propose Flow-HOA, a generative framework that jointly optimizes a multi-dimensional objective encompassing time-domain, spectral, and spatial fidelity while producing a deployable, time-invariant bank of Finite Impulse Response (FIR) encoding filters. Using conditional flow matching, the model learns to map a simple prior distribution to the target distribution of FIR filter
coefficients. Training is guided by a composite loss that balances time-domain waveform fidelity, multi-resolution spectral consistency, sub-band energy preservation, and spatial directivity constraints. Objective evaluations on synthetically simulated data demonstrate improved performance over strong model-based baselines in both signal fidelity and spatial accuracy metrics. Subjective listening tests on real microphone array recordings further confirm
that Flow-HOA yields higher overall sound quality with reduced artifacts, demonstrating generalization from synthetic training data to real-world capture conditions.

Details

AES Convention
160
Paper number
10293
Publication date
May 28, 2026
Session subject
AI and Machine Learning in Audio, Recording, Production, and Reproduction
Affiliation
State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University; State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University; State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University; Beijing Xiaomi Mobile Software Co., Ltd; Xiaomi Communications Co., Ltd (See document for exact affiliation information.)
Type
Convention Paper