Binaural reproduction of head-worn microphone array recordings with adjustable field-of-view control

Fernandez J, Alon D, Ben-Hur Z, Tourbabin V. Binaural reproduction of head-worn microphone array recordings with adjustable field-of-view control. In: AES 2024 International Conference on Audio for Virtual and Augmented Reality. Audio Engineering Society; 2024. Paper 7. Available from: https://aes.org/publications/elibrary-page/?id=22656

@inproceedings{Fernandez2024_22656,
  author = {Fernandez, Janani and Alon, David and Ben-Hur, Zamir and Tourbabin, Vladimir},
  title = {{Binaural reproduction of head-worn microphone array recordings with adjustable field-of-view control}},
  booktitle = {AES 2024 International Conference on Audio for Virtual and Augmented Reality},
  note = {Paper 7},
  year = {2024},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22656}
}

TY  - CPAPER
TI  - Binaural reproduction of head-worn microphone array recordings with adjustable field-of-view control
AU  - Fernandez, Janani
AU  - Alon, David
AU  - Ben-Hur, Zamir
AU  - Tourbabin, Vladimir
T2  - AES 2024 International Conference on Audio for Virtual and Augmented Reality
M1  - Paper 7
PY  - 2024
DA  - 2024/08/05
UR  - https://aes.org/publications/elibrary-page/?id=22656
PB  - Audio Engineering Society
LA  - en
AB  - This paper investigates an approach for reproducing head-worn microphone array recordings over headphones, such that the listener is also able to augment the rendering to emphasise sounds arriving within a particular field-of-view (FoV), while also attempting to preserve the spatial properties of the captured scene. This type of processing may find application within future augmented reality contexts. The directional emphasis is realised by applying an additional direction-dependent weighting term, when conducting the magnitude least-squares fitting of the array directivities to the binaural directivities. The proposed approach is presented alongside perceptual metric analysis and evaluated via a perceptual study involving 20 listeners. The results suggest that achieving a gain within a defined FoV is attainable, but there exists a trade-off between increasing gain and negatively impacting the spatial aspects of the reproduced sound scene.
ER  -