Investigating the perceptual impact of head-worn devices for augmented reality using a dynamic task with continuous head–eye tracking

Missoni F, Meyer J, Canessa A. Investigating the perceptual impact of head-worn devices for augmented reality using a dynamic task with continuous head–eye tracking. In: AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games. Audio Engineering Society; 2026. Paper 10338. Available from: https://aes.org/publications/elibrary-page/?id=23300

@inproceedings{Missoni2026_23300,
  author = {Missoni, Fulvio and Meyer, Julie and Canessa, Andrea},
  title = {{Investigating the perceptual impact of head-worn devices for augmented reality using a dynamic task with continuous head–eye tracking}},
  booktitle = {AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games},
  note = {Paper 10338},
  year = {2026},
  month = jun,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=23300}
}

TY  - CPAPER
TI  - Investigating the perceptual impact of head-worn devices for augmented reality using a dynamic task with continuous head–eye tracking
AU  - Missoni, Fulvio
AU  - Meyer, Julie
AU  - Canessa, Andrea
T2  - AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games
M1  - Paper 10338
PY  - 2026
DA  - 2026/06/30
UR  - https://aes.org/publications/elibrary-page/?id=23300
PB  - Audio Engineering Society
LA  - en
AB  - Augmented reality (AR) systems require listeners to wear head-worn devices (HWDs) such as headphones and head-mounted displays (HMDs), which can alter spatial hearing by modifying the acoustic cues reaching the listeners ears. Although acoustical and perceptual effects have been reported for isolated HWDs, most studies rely on simplified paradigms such as static sound source localisation tasks, providing limited insight into spatial perception in more ecological settings. In everyday listening, spatial perception is an active multisensory process in which listeners coordinate head and eye movements to build a stable representation of the environment, which may be disrupted by altered auditory cues. In this work, the perceptual impact of wearing HWDs was investigated using an auditory-aided visual search task with continuous tracking of head and eye movements. Multiple HWD configurations were compared, including two pairs of headphones with and without an HMD, to assess how scattering introduced by these devices affects spatial hearing in ecologically relevant AR scenarios. Results showed small but statistically significant effects of HWDs on exploration behaviour, primarily reflected in increased eyemovement search time, while head movements were only marginally affected. Across conditions, eye movements preceded head movements, with subtle differences in movement onset timing but limited impact on overall search performance. Overall, the findings indicate that HWDs introduce measurable but moderate changes in eyehead coordination, while largely preserving spatial search performance in ecologically valid listening conditions.
ER  -