Needlets for Spatial Audio: Objective Evaluations

Ekmen Ş, Lee H. Needlets for Spatial Audio: Objective Evaluations. In: AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games. Audio Engineering Society; 2026. Paper 500. Available from: https://aes.org/publications/elibrary-page/?id=23347

@inproceedings{Ekmen2026_23347,
  author = {Ekmen, Şafak and Lee, Hyunkook},
  title = {{Needlets for Spatial Audio: Objective Evaluations}},
  booktitle = {AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games},
  note = {Paper 500},
  year = {2026},
  month = jun,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=23347}
}

TY  - CPAPER
TI  - Needlets for Spatial Audio: Objective Evaluations
AU  - Ekmen, Şafak
AU  - Lee, Hyunkook
T2  - AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games
M1  - Paper 500
PY  - 2026
DA  - 2026/06/30
UR  - https://aes.org/publications/elibrary-page/?id=23347
PB  - Audio Engineering Society
LA  - en
AB  - This study introduces needlets, a specific class of spherical wavelets, for spatial audio applications. Needlets are constructed in the spherical harmonic domain, are mathematically well defined, possess good localisation properties, and facilitate multiresolution analysis. However, because they form a tight frame, they are redundant and therefore require sparsification for practical applications. We propose a comprehensive spatial audio framework based on needlets, spanning encoding through to head-tracking-enabled binaural rendering. In this framework, a sound scene is encoded into a redundant needlet dictionary, which is subsequently sparsified using a novel algorithm. The resulting sparse representation is then decoded for headphone reproduction. Scene rotation is achieved by applying SO(3) rotation matrices to the sparse representation. The perceptual implications of the frameworks design parameters were evaluated using objective metrics and compared with those of Ambisonics. Initial results show that the proposed framework can achieve better tonal and spatial fidelity than third- and fourth-order Ambisonics Magnitude Least-Squares decoding while using a similar number of channels. Moreover, the proposed framework has been shown to allow users to tune the reproduced sound scene while maintaining fidelity.
ER  -