Opens in a new tab

AES E-Library

← Back to search

Journal Article Open Access

Audio’s Impact on Immersive Experience in Extended Reality and Digital Games: A Systematic Review

Authors: Hedges, Jacob Michael; Sazdov, Robert; Johnston, Andrew

Journal of the Audio Engineering Society · Volume 72 · Issue 10 · pp. 630–649 · October 2024

Abstract

Extended reality and digital games strive to deliver a high level of “immersion,” a complex phenomenon influenced by both perceptual and psychological factors. Audio plays a crucial role in shaping immersive experiences, yet there is no clear consensus on its impact or on the best methods to evaluate it. This paper presents a systematic literature review spanning two decades, outlining the methods and findings related to how audio influences immersion in extended reality and digital games. It reveals a strong preference for experiments using virtual reality headsets and headphones and notes a gap in research on augmented and mixed reality environments. Moreover, it underscores the need for audio-specific metrics to better assess the ways that audio variables impact immersion. The findings demonstrate that audio elements like spatial fidelity, music, and the integration of sound in multimodal environments generally contribute to the immersive experience but also highlight a threshold beyond which further enhancements may not perceptibly improve the experience. It emphasizes the need for realtime, objective measures of immersion as well as the consideration of diverse methodological approaches to deepen the understanding of audio’s role in immersive technologies.

Details

Publication
Journal of the Audio Engineering Society
Volume
72
Issue
10
Pages
630–649
Publication date
October 15, 2024
Affiliation
Faculty of Arts and Social Sciences, University of Technology Sydney, Sydney, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, Australia (See document for exact affiliation information.)
Type
Journal Article