Neural modeling and interpolation of binaural room impulse responses with head tracking

Qiao Y, Choueiri E. Neural modeling and interpolation of binaural room impulse responses with head tracking. In: AES Convention 155. Audio Engineering Society; 2023. Paper 158. Available from: https://aes.org/publications/elibrary-page/?id=22312

@inproceedings{Qiao2023_22312,
  author = {Qiao, Yue and Choueiri, Edgar},
  title = {{Neural modeling and interpolation of binaural room impulse responses with head tracking}},
  booktitle = {AES Convention 155},
  note = {Paper 158},
  year = {2023},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22312}
}

TY  - CPAPER
TI  - Neural modeling and interpolation of binaural room impulse responses with head tracking
AU  - Qiao, Yue
AU  - Choueiri, Edgar
T2  - AES Convention 155
M1  - Paper 158
PY  - 2023
DA  - 2023/10/06
UR  - https://aes.org/publications/elibrary-page/?id=22312
PB  - Audio Engineering Society
LA  - en
AB  - The use of neural networks for modeling and interpolating binaural room impulse responses (BRIRs) is investigated for facilitating spatial audio applications that require head tracking in multiple degrees of freedom. A deep neural network model is adopted from an architecture originally proposed for neural representation problems to predict unknown BRIRs that contain salient early reflection peaks, given head coordinates. Instead of its original time-domain formulation, a frequency-domain formulation is proposed to enhance the model efficiency and flexibility for band-limited BRIRs. Both model formulations are evaluated with measured and simulated BRIRs in terms of modeling accuracy and interpolation performance, respectively. It is shown that the frequency-domain formulation is more effecient at modeling band-limited BRIRs than its time-domain counterpart as the former only learns the partial frequency spectrum, and that models with both formulations significantly outperform conventional methods for interpolating sparse BRIRs.
ER  -