Assessing Dynamic Balance in Virtual Reality: Sound Design and Implementation of the Audio System

Wu Y, Lin D, Roginska A, Olsen A, Arie L, Yagnik A, Lubetzky A. Assessing Dynamic Balance in Virtual Reality: Sound Design and Implementation of the Audio System. In: AES 2024 International Conference on Audio for Virtual and Augmented Reality. Audio Engineering Society; 2024. Paper 14. Available from: https://aes.org/publications/elibrary-page/?id=22663

@inproceedings{Wu2024_22663,
  author = {Wu, Yi and Lin, Delong and Roginska, Agnieszka and Olsen, Al and Arie, Liraz and Yagnik, Anjali and Lubetzky, Anat},
  title = {{Assessing Dynamic Balance in Virtual Reality: Sound Design and Implementation of the Audio System}},
  booktitle = {AES 2024 International Conference on Audio for Virtual and Augmented Reality},
  note = {Paper 14},
  year = {2024},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22663}
}

TY  - CPAPER
TI  - Assessing Dynamic Balance in Virtual Reality: Sound Design and Implementation of the Audio System
AU  - Wu, Yi
AU  - Lin, Delong
AU  - Roginska, Agnieszka
AU  - Olsen, Al
AU  - Arie, Liraz
AU  - Yagnik, Anjali
AU  - Lubetzky, Anat
T2  - AES 2024 International Conference on Audio for Virtual and Augmented Reality
M1  - Paper 14
PY  - 2024
DA  - 2024/08/05
UR  - https://aes.org/publications/elibrary-page/?id=22663
PB  - Audio Engineering Society
LA  - en
AB  - This paper presents a novel multi-modality audio system designed for a virtual reality (VR) balance performance assessment application, examining how headphone and loudspeaker reproduction of auditory cues impacted dynamic balance and motor control in healthy young adults. Participants in the simulation were instructed to dodge incoming balls while reacting to various visual cues, facing cognitive challenges, and being exposed to different auditory conditions via headphones or loudspeakers. The experiment was divided into three parts, each incorporating various sound designs: synchronized foreground ball sounds, background distracting sounds, and directional notification sounds. These sounds were delivered through four modalities: Headphones, Loudspeakers, Room Simulation (headphones with room acoustic simulation), and Passthrough (loudspeakers with headphones worn). This paper provides a comprehensive description of the audio systems architecture, technical implementation, and sound design choices. The findings offer valuable insights into designing audio systems for VR-based physical therapy and balance assessment, supporting the future development of applications ranging from user-friendly home setups to advanced clinical tools for analyzing and rehabilitating human movement and balance.
ER  -