Convention Paper
MotionMix: A Gestural Audio Mixing Controller
AES Convention 137 · Paper 9215 · October 2014
Abstract
This paper presents a control interface for stereo mixing using real time computer vision. The user’s sense of depth and panorama are improved over the traditional channel strip, while broad accessibility is maintained by integrating the system with Digital Audio Workstation (DAW) software and implementing a system that is portable and affordable. To provide the user with a heightened sense of sound spatialization over the traditional channel strip, the concept of depth is addressed directly using the stage metaphor. Sound sources are represented as colored spheres in a graphical user interface to provide the user with visual feedback. Moving sources back and forward controls volume, while left to right controls panning. Preliminary evaluation is conducted through a pilot study, and user feedback is considered regarding future applications of the interface.
