Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Gaussian Splatting-Based Head and Pinna Reconstruction for Individualized HRTF Computation from Commodity Multi-View Images

Authors: Zhu, Houlin; Wu, Xihong; Qu, Tianshu

Convention Paper · Paper 10290 · May 2026

Abstract

Individualized head-related transfer functions (HRTFs) require accurate pinna geometry, yet commodity multi-view captures leave the ear region self-occluded and weakly textured. We present a practical pipeline that couples ear-centric acquisition with 3D Gaussian splatting (3DGS) and the boundary element method (BEM) for complete HRTF computation. The protocol augments horizontal views with per-ear elevated captures under directional lighting; 3DGS training with depth-distortion regularization yields watertight meshes via truncated signed distance function (TSDF) fusion. Standardized head coordinates and ear-canal annotations interface the mesh with BEM. Experimental evaluations demonstrate that our method achieves lower ear-region geometric error and lower full-band spectral distortion compared to existing image-based personalized reconstruction baselines including AudioEar, NeuS, and Metashape MVS.

Details

AES Convention
160
Paper number
10290
Publication date
May 28, 2026
Session subject
Immersive Audio, Recording, Production, and Reproduction
Type
Convention Paper