Opens in a new tab

AES E-Library

← Back to search

Convention Paper

FoleySonic: Placing Sounds on a Timeline through Gestures

Authors: Black, David; Gohlke, Kristian; Loviscach, Jörn

AES Convention 128 · Paper 8004 · May 2010

Abstract

The task of sound placement on video timelines is usually a time-consuming process that requires the sound design-er or foley artist to carefully calibrate the position and length of each sound sample. For novice and home video producers, friendlier and more entertaining input methods are needed. We demonstrate a novel approach that har-nesses the motion-sensing capabilities of readily available input devices, such as the Nintendo Wii Remote or mod-ern smart phones, to provide intuitive and fluid arrangement of samples on a timeline. Users can watch a video while simultaneously adding sound effects, providing a near real-time workflow. The system leverages the user’s motor skills for enhanced expressiveness and provides a satisfying experience while accelerating the process.

Details

Published in
AES Convention 128
AES Convention
128
Paper number
8004
Publication date
May 6, 2010
Session subject
Audio Equipment and Emerging Technologies
Affiliation
University of Applied Sciences, Bielefeld, Bielefeld, Germany; University of Applied Sciences, Bremen, Bremen, Germany (See document for exact affiliation information.)
Type
Convention Paper