Opens in a new tab

AES E-Library

← Back to search

Convention Paper

KnuckleTap - Exploring the Possibilities of Audio Input in a Mobile Rhythmic Notepad Application

Authors: Rubisch, Julian; Jaksche, Michael

AES Convention 132 · Paper 8661 · April 2012

Abstract

Apart from some significant contributions in the scientific community and a few notable product innovations,

audio input for musical interaction purposes on mobile devices has until now been widely neglected as a

control parameter. This situation does not correspond to the fact that musical ideas are often vocalized

and developed by musicians using their voice or other sounding objects, nor does it take advantage of

contemporary mobile devices' most rigid and reliable sensor - the microphone. As an example case exploiting

these possibilities, we conceived a notepad application to track rhythmic ideas by recording taps on a surface

with a smartphone's built-in microphone, refined by subsequent detection of onsets, clustering, instantaneous

rearranging of the detected events, and export capabilities.

Details

Published in
AES Convention 132
AES Convention
132
Paper number
8661
Publication date
April 6, 2012
Session subject
Education, Human Factors, and Applications
Affiliation
breakingwav.es, Vienna, Austria; St Poelten Univerrsity of Applied Sciences, St Poelten, Austria (See document for exact affiliation information.)
Type
Convention Paper