Opens in a new tab

AES E-Library

← Back to search

Convention Paper

A Method for Multimodal Auralization of Audio-Tactile Stimuli from Acoustic and Structural Measurements

Authors: Abercrombie, Clemeth; Braasch, Jonas

AES Convention 127 · Paper 7867 · October 2009

Abstract

A new method for the reproduction of sound and vibration for arbitrary musical source material based on physical measurements is presented. Tactile signals are created by the convolution of ”uncoupled” vibration with impulse responses derived from mechanical impedance measurements. Audio signals are created by the convolution of anechoic sound with binaural room impulse responses. Playback is accomplished through headphones and a calibrated motion platform. Benefits of the method include the ability to make multimodal, side-by-side listening tests for audio-tactile stimuli perceived in real music performance situations. Details of the method are discussed along with obstacles and applications. Structural response measurements are presented as validation of the need for measured vibration signals in audio-tactile displays.

Details

Published in
AES Convention 127
AES Convention
127
Paper number
7867
Publication date
October 6, 2009
Session subject
Audio in Multimodal Applications
Affiliation
Rensselaer Polytechnic Institute, Troy, NY, USA (See document for exact affiliation information.)
Type
Convention Paper