Ambisonics and rotation matrices are a natural fit for 360° video and virtual, augmented or mixed reality experiences where spatial audio representation and transformation are required. As such, ambisonics has been widely adopted in AR/VR production workflows. For fully immersive experiences, however, extensions to support arbitrary six-degree-of-freedom listener movement in a sound scene are necessary. This paper introduces extensions to ambisonics formats to support authoring, encoding, decoding, and rendering depth information to enable full 3D immersive audio suitable for true 3D, volumetric, or light field video. The paper describes ambisonic decoding architectures that support depth rendering and 6DoF with both legacy ambisonic content and the proposed encoding extensions and discusses an end-to-end solution for spatial audio transmission or streaming.
(See document for exact affiliation information.)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
