The Influence of Visual Cues on the Sound Externalization of Virtual Loudspeaker Setups

Scheer C, Lau F, Sander C, Weinzierl S, Arend JM. The Influence of Visual Cues on the Sound Externalization of Virtual Loudspeaker Setups. J Audio Eng Soc. 2026;74(1/2). doi:10.17743/jaes.2022.0241

@article{Scheer2026_23118,
  author = {Scheer, Christian and Lau, Felix and Sander, Cristian and Weinzierl, Stefan and Arend, Johannes M.},
  title = {{The Influence of Visual Cues on the Sound Externalization of Virtual Loudspeaker Setups}},
  journal = {Journal of the Audio Engineering Society},
  volume = {74},
  number = {1/2},
  url = {https://doi.org/10.17743/jaes.2022.0241},
  doi = {10.17743/jaes.2022.0241},
  year = {2026},
  month = feb,
  publisher = {Audio Engineering Society}
}

TY  - JOUR
TI  - The Influence of Visual Cues on the Sound Externalization of Virtual Loudspeaker Setups
AU  - Scheer, Christian
AU  - Lau, Felix
AU  - Sander, Cristian
AU  - Weinzierl, Stefan
AU  - Arend, Johannes M.
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 74
IS  - 1/2
PY  - 2026
DA  - 2026/02/10
DO  - 10.17743/jaes.2022.0241
UR  - https://doi.org/10.17743/jaes.2022.0241
PB  - Audio Engineering Society
LA  - en
AB  - Research has shown that visual cues influence the perceived sound externalization of binaural reproduction. However, it remains unclear whether providing a virtual visual representation of loudspeakers in addition to their binaural rendering influences their perceived externalization. Using augmented reality (AR), loudspeakers can be visualized within the listener’s environment, potentially improving the externalization of binaural loudspeaker renderings. This study presents a listening experiment using dynamic binaural rendering of a typical 7.0.4 immersive loudspeaker setup. Participants rated the externalization of noise bursts rendered as single loudspeaker sources, phantom sources, and moving sources, as well as immersive music, under three different visual conditions. Results show that the AR visualization significantly improves the externalization for noise bursts reproduced by single virtual loudspeakers and for immersive music excerpts reproduced by the entire virtual loudspeaker setup but not for phantom and moving sources. Thus, shifting a percept farther away from the head seems to work best when the acoustically perceived sound direction matches the visual source location. The effectiveness of AR visualization for immersive music, on the other hand, may be due to listeners’ familiarity with spatial music productions over loudspeakers.
ER  -