Opens in a new tab

AES E-Library

← Back to search

Conference Paper

Perceptual Weighting of Binaural Information: Toward an Auditory Perceptual "Spatial Codec" for Auditory Augmented Reality

Authors: Stecker, G. Christopher; Diedesch, Anna

AES Conference: 2016 AES International Conference on Audio for Virtual and Augmented Reality · Paper 6-2 · September 2016

Abstract

Auditory augmented reality (AR) requires accurate estimation of spatial information conveyed in the natural scene, coupled with accurate spatial synthesis of virtual sounds to be integrated within it. Solutions to both problems should consider the capabilities and limitations of the human binaural system, in order to maximize relevant over distracting acoustic information and enhance perceptual integration across AR layers. Recent studies have measured how human listeners integrate spatial information across multiple conflicting cues, revealing patterns of “perceptual weighting” that sample the auditory scene in a robust but spectrotemporally sparse manner. Such patterns can be exploited for binaural analysis and synthesis, much as time-frequency masking patterns are exploited by perceptual audio codecs, to improve efficiency and enhance perceptual integration.

Details

Published in
AES Conference: 2016 AES International Conference on Audio for Virtual and Augmented Reality
Paper number
6-2
Publication date
September 6, 2016
Session subject
Perceptual Consideration for VR/AR
Affiliation
Vanderbilt University School of Medicine, Nashville, TN, USA (See document for exact affiliation information.)
Type
Conference Paper