Opens in a new tab

AES E-Library

← Back to search

Conference Paper

Personalized Head-Related Transfer Function Modeling Using a Neural Operator

Authors: Lu, Chenshen; McMullen, Kyla

AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 10344 · June 2026

Abstract

Virtual, augmented, and mixed reality experiences are becoming more commonplace as consumer-grade devices proliferate. Head-Related Transfer Functions (HRTFs) are used to create realistic spatial audio in virtual and augmented environments. Mathematically, HRTFs represent solutions to acoustic boundary-value scattering problems governed by the Helmholtz equation. Neural operators are neural networks designed to learn the solutions of partial differential equations (PDEs). The present work proposes an operator-learning framework based on the Deep Operator Network (DeepONet) for individualized HRTF prediction. By implementing a non-uniform sampling strategy for 3-D head meshes and data compression along the frequency axis, the framework achieves highfidelity predictions while reducing data dimensionality. Our method shows low log-spectral distortion, generalizes to unseen spatial grids, and infers an entire heads HRTF field in 0:3 seconds. Objective evaluations demonstrate the frameworks effectiveness in personalization and spatial interpolation. Furthermore, robust performance on unseen subjects and coordinates highlights the models generalization capability, offering a computationally efficient alternative for HRTFs personalization. Codes are available at https://github.com/chenshenlu/NOPHRTF_AES.

Details

Published in
AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games
Paper number
10344
Publication date
June 30, 2026
Session subject
Machine learning, deep learning, or AI for audio, Spatial audio (3D audio, ambisonics, object-based)
Type
Conference Paper