Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Musical Movements—Gesture Based Audio Interfaces

Authors: Churnside, Anthony; Pike, Chris; Leonard, Max

AES Convention 131 · Paper 8496 · October 2011

Abstract

Recent developments have led to the availability of consumer devices capable of recognising certain human movements and gestures. This paper is a study of novel gesture-based audio interfaces. The authors present two prototypes for interacting with audio/visual experiences. The first allows a user to ‘conduct’ a recording of an orchestral performance, controlling the tempo and dynamic. The paper describes the audio and visual capture of the orchestra and the design and construction of the audio-visual playback system. An analysis of this prototype, based on testing and feedback from a number of users, is also provided. The second prototype uses the gesture tracking algorithm to control a three-dimensional audio panner. This audio panner is tested and feedback from a number of professional engineers is analysed.

Details

Published in
AES Convention 131
AES Convention
131
Paper number
8496
Publication date
October 6, 2011
Session subject
Applications in Audio
Affiliation
BBC R&D, Media City, Salford, UK (See document for exact affiliation information.)
Type
Convention Paper