The sonification of handwriting has been shown effective in various learning tasks. In this paper, the authors investigate the sound design used for handwriting interaction based on a simple and cost-efficient prototype. The authentic interaction sound is compared with physically informed sonification designs that employ either natural or inverted mapping. In an experiment, participants copied text and drawings. The authors found simple measures of the structure-borne audio signal that showed how participants were affected in their movements, but only when drawing. In contrast, participants rated the sound features differently only for writing. The authentic interaction sound generally scored best, followed by a natural sonification mapping.

Authors: Gross-Vogt, Katharina; Rachdi, Noah; Frank, Matthias
Affiliation: Institute of Electronic Music and Acoustics, University of Music and Performing Arts, Graz, Austria
JAES Volume 72 Issue 5 pp. 290-298; May 2024
Publication Date: May 3, 2024 Import into BibTeX
Permalink: https://www.aes.org/e-lib/browse.cfm?elib=22420

Download Now (603 KB)

This paper is Open Access which means you can download it for free.

Learn more about the AES E-Library

E-Library Location: (CD JAES72)   /jaes72/5/pg290.pdf

DOI: https://doi.org/10.17743/jaes.2022.0148

Start a discussion about this paper!