Opens in a new tab

AES E-Library

← Back to search

Conference Paper Open Access

6DoF Rendering of Multi-Point Ambisonics Recordings at Listening Positions Exterior to the Area Defined by Microphone Positions

Authors: Leppänen, Jussi; Politis, Archontis; Laitinen, Mikko-Ville; Pajunen, Lauros; Eronen, Antti

AES 2024 International Conference on Audio for Virtual and Augmented Reality · Paper 13 · August 2024

Abstract

This work presents a method for 6DoF binaural rendering from multi-point first- or higher-order Ambisonic (FOA/HOA) recordings for the case when the listener is outside of the area covered by the microphones. This work builds on top of a previously presented method for 6DoF binaural rendering when the listener is inside the area covered by the microphones [1]. The method measures spatial parameters in the time-frequency domain that summarize the scene at the microphone positions. It then estimates the same parameters at the listener position through spatial interpolation of the measured ones. In this work, the spatial parameter calculation is modified to accommodate situations where spatial interpolation is not possible as described in the previous work. A real-time 6DoF listening preference test demonstrates that the proposed method provides plausible rendering when the listener is outside of the microphone area. This work is related to the upcoming MPEG-I immersive audio standard (ISO/IEC 23090-4) which is defining 6DoF immersive audio technology for AR and VR scenarios.

Details

Published in
AES 2024 International Conference on Audio for Virtual and Augmented Reality
Paper number
13
Publication date
August 5, 2024
Session subject
Audio for Virtual and Augmented Reality
Affiliation
Nokia Technologies, Finland; Nokia Technologies, Finland; Nokia Technologies, Finland; Nokia Technologies, Finland; Audio Research Group, Tampere University, Finland (See document for exact affiliation information.)
Type
Conference Paper