Real-Time Dynamic Acoustics in 6DoF VR for Amateur Singers

Niimura A, Serafin S, Kaplanis N. Real-Time Dynamic Acoustics in 6DoF VR for Amateur Singers. In: AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference. Audio Engineering Society; 2022. Paper 24. Available from: https://aes.org/publications/elibrary-page/?id=21854

@inproceedings{Niimura2022_21854,
  author = {Niimura, Aili and Serafin, Stefania and Kaplanis, Neo},
  title = {{Real-Time Dynamic Acoustics in 6DoF VR for Amateur Singers}},
  booktitle = {AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference},
  note = {Paper 24},
  year = {2022},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21854}
}

TY  - CPAPER
TI  - Real-Time Dynamic Acoustics in 6DoF VR for Amateur Singers
AU  - Niimura, Aili
AU  - Serafin, Stefania
AU  - Kaplanis, Neo
T2  - AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference
M1  - Paper 24
PY  - 2022
DA  - 2022/08/06
UR  - https://aes.org/publications/elibrary-page/?id=21854
PB  - Audio Engineering Society
LA  - en
AB  - This paper investigates the perception of one’s own voice in a virtual acoustic space in the context of singing. We will look into how real-time geometry-based virtual reflections affect the performance of a singer as well as their comfort and enjoyment in the act of singing in a 6DoF VR environment. In this process, we designed a low-latency virtual acoustic processing system in tandem with an immersive virtual environment to test the enjoyment and acoustic preferences of amateur singers in VR. The quantitative and qualitative results suggest that dynamic acoustic processing was more enjoyable for singers and that the singers’ confidence was affected by the virtual acoustics. The results have implications on virtual acoustics in the context of music performances in social VR as well as embodiment, presence, immersion and expression in other shared virtual environments. Through the interpretation of results, we suggest improvements for creating richer experiences for performers in virtual acoustic spaces.
ER  -