AES E-Library

Machine learning based prediction for Personalized Head Related Transfer Functions based on video capture

Over the past decade, audio for extended reality has become critical to deliver a truly immersive sound experience. With headphones being a popular medium for playback, binaural audio is one of the most convenient formats to deliver accurate spatial audio. Personalized Head-related Transfer Functions (HRTFs) are an integral component of binaural audio that determines the quality of the spatial audio experience. In this paper, we present a pilot research that predicts personalized HRTFs based on 2D images or a video capture. We explore different components in this process including the 3D reconstruction of an ear based on 2D images or video followed by the HRTF estimation using HRTF prediction using Neural Networks.

 

Author (s):
Affiliation: (See document for exact affiliation information.)
Publication Date:
Session subject:

DOI:


Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.

Type:
16938
Choose your country of residence from this list: