Real-Time Tracking of Speech Sources Using Binaural Audio and Orientation Tracking

Karjalainen M, Takanen M. Real-Time Tracking of Speech Sources Using Binaural Audio and Orientation Tracking. In: AES Conference: 40th International Conference: Spatial Audio: Sense the Sound of Space. Audio Engineering Society; 2010. Paper P-13. Available from: https://aes.org/publications/elibrary-page/?id=15540

@inproceedings{Karjalainen2010_15540,
  author = {Karjalainen, Matti and Takanen, Marko},
  title = {{Real-Time Tracking of Speech Sources Using Binaural Audio and Orientation Tracking}},
  booktitle = {AES Conference: 40th International Conference: Spatial Audio: Sense the Sound of Space},
  note = {Paper P-13},
  year = {2010},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=15540}
}

TY  - CPAPER
TI  - Real-Time Tracking of Speech Sources Using Binaural Audio and Orientation Tracking
AU  - Karjalainen, Matti
AU  - Takanen, Marko
T2  - AES Conference: 40th International Conference: Spatial Audio: Sense the Sound of Space
M1  - Paper P-13
PY  - 2010
DA  - 2010/10/06
UR  - https://aes.org/publications/elibrary-page/?id=15540
PB  - Audio Engineering Society
LA  - en
AB  - This article presents a method for real-time estimation of the directions of speech sources from captured binaural audio. Accurate direction estimates are required in order to embed the sound sources correctly to the auditory environment of the far-end user in telecommunication between two augmented reality audio (ARA) users. The dependency of the estimation accuracy on the orientation of the near-end user is avoided in this method by combining the information from an orientation tracker to the direction estimates. The results from the anechoic experiments illustrate that the presented method can estimate the direction(s) of non-simultaneous speech source(s) in real-time, and that head movement improves the estimation accuracy of sources on the sides of the user.
ER  -