Acoustic Zooming by Multi-Microphone Sound Scene Manipulation

van Waterschoot T, Tirry WJ, Moonen M. Acoustic Zooming by Multi-Microphone Sound Scene Manipulation. J Audio Eng Soc. 2013;61(7/8):489-507. Available from: https://aes.org/publications/elibrary-page/?id=16866

@article{vanWaterschoot2013_16866,
  author = {van Waterschoot, Toon and Tirry, Wouter Joos and Moonen, Marc},
  title = {{Acoustic Zooming by Multi-Microphone Sound Scene Manipulation}},
  journal = {Journal of the Audio Engineering Society},
  volume = {61},
  number = {7/8},
  pages = {489--507},
  year = {2013},
  month = jul,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=16866}
}

TY  - JOUR
TI  - Acoustic Zooming by Multi-Microphone Sound Scene Manipulation
AU  - van Waterschoot, Toon
AU  - Tirry, Wouter Joos
AU  - Moonen, Marc
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 61
IS  - 7/8
SP  - 489
EP  - 507
PY  - 2013
DA  - 2013/07/06
UR  - https://aes.org/publications/elibrary-page/?id=16866
PB  - Audio Engineering Society
LA  - en
AB  - Camera zooming would be more compelling if the audio was subjected to a corresponding zoom that matched the video. Psychophysical and neuroimaging results suggest that a cross-modal approach to zooming facilitates multisensory integration. Because auditory distance perception is primarily determined by sound intensity, an audiovisual zoom effect can be obtained by matching the levels of different sources in a sound scene with their visually perceived distance. The authors propose a general theory for independent sound source level control that can be used to attain an acoustic zoom effect. The theory does not require sound source separation, which reduces computational load. An efficient implementation using fixed and adaptive spatial and spectral noise-reduction algorithms is proposed and evaluated. Experimental results using an array of a small number of low-cost microphones confirm that the proposed approach is particularly suited for consumer audiovisual capture applications.
ER  -