A Neural Beamforming Front-end for Distributed Microphone Arrays

Ziegler J, Schröder L, Koch A, Schilling A. A Neural Beamforming Front-end for Distributed Microphone Arrays. In: AES Convention 151. Audio Engineering Society; 2021. Paper 10508. Available from: https://aes.org/publications/elibrary-page/?id=21472

@inproceedings{Ziegler2021_21472,
  author = {Ziegler, Jonathan and Schröder, Leon and Koch, Andreas and Schilling, Andreas},
  title = {{A Neural Beamforming Front-end for Distributed Microphone Arrays}},
  booktitle = {AES Convention 151},
  note = {Paper 10508},
  year = {2021},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21472}
}

TY  - CPAPER
TI  - A Neural Beamforming Front-end for Distributed Microphone Arrays
AU  - Ziegler, Jonathan
AU  - Schröder, Leon
AU  - Koch, Andreas
AU  - Schilling, Andreas
T2  - AES Convention 151
M1  - Paper 10508
PY  - 2021
DA  - 2021/10/06
UR  - https://aes.org/publications/elibrary-page/?id=21472
PB  - Audio Engineering Society
LA  - en
AB  - Robust real-time audio signal enhancement increasingly relies on multichannel microphone arrays for signal acquisition. Sophisticated beamforming algorithms have been developed to maximize the benefit of multiple microphones. With the recent success of deep learning models created for audio signal processing, the task of Neural Beamforming remains an open research topic. This paper presents a Neural Beamformer architecture capable of performing spatial beamforming with microphones randomly distributed over very large areas, even in negative signal-to-noise ratio environments with multiple noise sources and reverberation. The proposed method combines adaptive, nonlinear filtering and the computation of spatial relations with state-of-the-art mask estimation networks. The resulting End-to-End network architecture is fully differentiable and provides excellent signal separation performance. Combining a small number of principal building blocks, the method is capable of low-latency, domain-specific signal enhancement even in challenging environments.
ER  -