A Natural Sonification Mapping for Handwriting

Gross-Vogt K, Rachdi N, Frank M. A Natural Sonification Mapping for Handwriting. J Audio Eng Soc. 2024;72(5):290-298. doi:10.17743/jaes.2022.0148

@article{GrossVogt2024_22602,
  author = {Gross-Vogt, Katharina and Rachdi, Noah and Frank, Matthias},
  title = {{A Natural Sonification Mapping for Handwriting}},
  journal = {Journal of the Audio Engineering Society},
  volume = {72},
  number = {5},
  pages = {290--298},
  year = {2024},
  month = may,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2022.0148},
  url = {https://doi.org/10.17743/jaes.2022.0148}
}

TY  - JOUR
TI  - A Natural Sonification Mapping for Handwriting
AU  - Gross-Vogt, Katharina
AU  - Rachdi, Noah
AU  - Frank, Matthias
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 72
IS  - 5
SP  - 290
EP  - 298
PY  - 2024
DA  - 2024/05/01
DO  - 10.17743/jaes.2022.0148
UR  - https://doi.org/10.17743/jaes.2022.0148
PB  - Audio Engineering Society
LA  - en
AB  - The sonification of handwriting has been shown effective in various learning tasks. In this paper, the authors investigate the sound design used for handwriting interaction based on a simple and cost-efficient prototype. The authentic interaction sound is compared with physically informed sonification designs that employ either natural or inverted mapping. In an experiment, participants copied text and drawings. The authors found simple measures of the structure-borne audio signal that showed how participants were affected in their movements, but only when drawing. In contrast, participants rated the sound features differently only for writing. The authentic interaction sound generally scored best, followed by a natural sonification mapping.
ER  -