Conference Paper
A Sound Architect's Guide to Spatial Audio on XR Devices
AES 2024 International Conference on Audio for Virtual and Augmented Reality · Paper 32 · August 2024
Abstract
The immersive audio industry has seen remarkable growth and complexity, driven by the increasing demand for interactive experiences. Traditional stereo audio formats are inadequate for creating truly immersive environments, prompting the adoption of advanced spatial audio formats like Ambisonics and Dolby Atmos. Despite these advancements, producing high-quality spatial audio content often requires expensive multi-channel speaker setups, which can be challenging for smaller studios. With headphones being the primary mode of audio consumption, it is essential to accurately monitor spatial audio on these devices. This paper presents innovative tools and workflows designed for virtual production on XR devices, empowering sound designers to mix and master spatial audio using high-fidelity headphones. These tools utilize personalized head-related transfer functions (HRTFs) and sophisticated physics-based modeling to simulate studio acoustics, ensuring immersive audio experiences. The approach supports both object-based and multichannel audio processing, enabling sound designers to create rich and dynamic audio environments. By virtualizing studios binaurally, the proposed system offers a cost-effective and accessible solution for immersive audio production, making advanced spatial audio techniques more attainable for smaller studios and individual creators.
