Opens in a new tab

AES E-Library

← Back to search

Conference Paper

Voxel-based occlusion and diffraction modelling for the upcoming ISO/MPEG standard for VR and AR

Authors: Terentiv, Leon; Fersch, Christof; Fischer, Daniel; Setiawan, Panji

AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference · Paper 10 · August 2022

Abstract

Following recent trends of fully immersive virtual reality (VR) and augmented reality (AR) applications, ISO/IEC JTC1 SC29 WG6, MPEG Audio coding, decided to create the MPEG-I Audio work-item for standardizing a solution for audio rendering in such applications, in which the user can navigate and interact with the environment using 6 degrees of freedom (6DoF). One of the main capabilities of MPEG-I Audio will be the support of real-time modeling of acoustic occlusion and diffraction effects for geometrically complex VR/AR scenes, including a high degree of user interactivity. This can be achieved by employing a voxel-based representation of sound-occluding scene elements in combination with computationally efficient rendering algorithms, operating on uniform 3D voxel grids and their 2D projections. This paper describes the chosen reference model architecture for voxel-based acoustic occlusion and diffraction modeling, operating modes and envisioned applications. In addition, it summarizes the current status of the MPEG-I Audio standardization process.

Details

Published in
AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference
Paper number
10
Publication date
August 6, 2022
Session subject
Paper
Affiliation
Dolby Germany GmbH, Nuremberg, Germany (See document for exact affiliation information.)
Type
Conference Paper