Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Perception of Simultaneity and Detection of Asynchrony between Audio and Structural Vibration in Multimodal Music Reproduction

Authors: Kim, Sungyoung; Martens, William L.; Walker, Kent

AES Convention 120 · Paper 6825 · May 2006

Abstract

In music reproduction incorporating haptic display there is a need to know the human observer’s tolerance for asynchrony between presentations of audio (airborne vibration) and haptic content (in this case whole-body vibration). Two methods for measuring the human tolerance for such audio-haptic asynchrony were employed in experiments using recorded musical instrument sound as stimuli: judgments of the time-order of arrival of airborne versus structure-borne vibration, and judgments of subjective simultaneity that required no report of which component arrived first. Optimal intermodal delay values derived from the time-order judgments were related to the direct judgments of simultaneity for the same set of stimuli.

Details

Published in
AES Convention 120
AES Convention
120
Paper number
6825
Publication date
May 6, 2006
Session subject
Psychoacoustics, Perception, and Listening Tests
Affiliation
McGill University (See document for exact affiliation information.)
Type
Convention Paper