Capturing Spatial Room Information for Reproduction in XR Listening Environments

Matsakis M, Songmuang P, Zhang K. Capturing Spatial Room Information for Reproduction in XR Listening Environments. In: AES Convention 152. Audio Engineering Society; 2022. Paper 10588. Available from: https://aes.org/publications/elibrary-page/?id=21701

@inproceedings{Matsakis2022_21701,
  author = {Matsakis, Michael and Songmuang, Parichat and Zhang, Kathleen},
  title = {{Capturing Spatial Room Information for Reproduction in XR Listening Environments}},
  booktitle = {AES Convention 152},
  note = {Paper 10588},
  year = {2022},
  month = may,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21701}
}

TY  - CPAPER
TI  - Capturing Spatial Room Information for Reproduction in XR Listening Environments
AU  - Matsakis, Michael
AU  - Songmuang, Parichat
AU  - Zhang, Kathleen
T2  - AES Convention 152
M1  - Paper 10588
PY  - 2022
DA  - 2022/05/06
UR  - https://aes.org/publications/elibrary-page/?id=21701
PB  - Audio Engineering Society
LA  - en
AB  - An expansion on previous work involving “holographic sound recording” (HSR), this research delves into how sound sources for directional ambience should be captured for reproduction in a 6-DOF listening environment. We propose and compare two systems of ambient capture for extended reality (XR) using studio-grade microphones and first-order soundfield microphones. Both systems are based on the Hamasaki-square ambience capture technique. The Twins-Hamasaki Array utilizes four Sennheiser MKH800 Twins while the Ambeo-Hamasaki Array uses four Sennheiser Ambeo microphones. In a preliminary musical recording and exploration of both techniques, the spatial capture from these arrays, along with additional holophonic spot systems, were reproduced using Steam Audio in Unity’s 3D engine. Preliminary analysis was conducted with expert listeners to examine these proposed systems using perceptual audio attributes.The systems were compared with each other as well as a virtual ambient space generated using Steam Audio as a reference point for auditory room reconstruction in XR. Initial analysis shows progress towards a methodology for capturing directional room reflections using Hamasaki-based arrays.
ER  -