Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Audio-Visual Processing Tools for Auditory Scene Synthesis

Authors: Boland, Frank; Dahyot, Rozenn; Kearney, Gavin

AES Convention 124 · Paper 7365 · May 2008

Abstract

We present an integrated set of audio-visual tracking and synthesis tools to aid matching of the audio to the video position in both horizontal and periphonic sound reinforcement systems. Compensation for screen size and loudspeaker layout for high definition formats is incorporated and the spatial localisation of the source is rendered using advanced spatialisation techniques. A subjective comparison of several original and enhanced film sequences using the Vector Base Amplitude Panning (VBAP) method is presented. The results show that the encoding of non-contradictory audio-visual spatial information, for presentation on different loudspeaker layouts significantly improves the naturalness of the listening/viewing experience.

Details

Published in
AES Convention 124
AES Convention
124
Paper number
7365
Publication date
May 6, 2008
Session subject
Spatial Audio Perception and Processing
Affiliation
Trinity College Dublin (See document for exact affiliation information.)
Type
Convention Paper