Opens in a new tab

AES E-Library

← Back to search

Convention Paper

MotionMix: A Gestural Audio Mixing Controller

Authors: Ratcliffe, Jarrod

AES Convention 137 · Paper 9215 · October 2014

Abstract

This paper presents a control interface for stereo mixing using real time computer vision. The user’s sense of depth and panorama are improved over the traditional channel strip, while broad accessibility is maintained by integrating the system with Digital Audio Workstation (DAW) software and implementing a system that is portable and affordable. To provide the user with a heightened sense of sound spatialization over the traditional channel strip, the concept of depth is addressed directly using the stage metaphor. Sound sources are represented as colored spheres in a graphical user interface to provide the user with visual feedback. Moving sources back and forward controls volume, while left to right controls panning. Preliminary evaluation is conducted through a pilot study, and user feedback is considered regarding future applications of the interface.

Details

Published in
AES Convention 137
AES Convention
137
Paper number
9215
Publication date
October 6, 2014
Session subject
Applications in Audio
Affiliation
New York University, New York, NY, USA (See document for exact affiliation information.)
Type
Convention Paper