Video-Based Head Tracking for Improvements in Multichannel Loudspeaker Audio

Kyriakakis C, Holman T. Video-Based Head Tracking for Improvements in Multichannel Loudspeaker Audio. In: AES Convention 105. Audio Engineering Society; 1998. Paper 4845. Available from: https://aes.org/publications/elibrary-page/?id=8335

@inproceedings{Kyriakakis1998_8335,
  author = {Kyriakakis, Chris and Holman, Tomlinson},
  title = {{Video-Based Head Tracking for Improvements in Multichannel Loudspeaker Audio}},
  booktitle = {AES Convention 105},
  note = {Paper 4845},
  year = {1998},
  month = sep,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=8335}
}

TY  - CPAPER
TI  - Video-Based Head Tracking for Improvements in Multichannel Loudspeaker Audio
AU  - Kyriakakis, Chris
AU  - Holman, Tomlinson
T2  - AES Convention 105
M1  - Paper 4845
PY  - 1998
DA  - 1998/09/06
UR  - https://aes.org/publications/elibrary-page/?id=8335
PB  - Audio Engineering Society
LA  - en
AB  - Multichannel audio rendering systems can benefit greatly from tracking the coordinates of the listener's head. In two-channel stereo, head tracking allows dynamic adjustment of the time of arrival of sound from each loudspeaker so that the listener is always placed in the sweet spot. For 5.1 channel material rendered over 5.1 loudspeakers, head tracking can be used to account for imaging distortion that occurs when the listener is outside the optimum listening area. Finally, in 5.1 channel material rendered over 2 (or 2.1) loudspeakers using 3-D audio signal processing techniques, knowing the location of the listener's head is the most critical factor that affects the performance of such systems. The crosstalk cancellation filters required to render virtual loudspeaker positions are critically dependent on precise positioning of the listener's ears. Without head tracking and dynamic adjustment of filter parameters in response to head movement, the functionality of such systems is extremely limited. In this paper we present a video-based architecture for tracking the listener unobtrusively combined with a novel approach to crosstalk filter design that can be modified in real time based on information provided by the head tracking algorithm.
ER  -