Opens in a new tab

AES E-Library

← Back to search

Journal Article

Touch the Sound: Design and Development of a Tangible System for Sound Experimentation

Authors: Cuadrado, Francisco

Journal of the Audio Engineering Society · Volume 66 · Issue 6 · pp. 478–485 · June 2018

Abstract

“Touch the Sound” is a technological tool specifically designed for children training in experimentation of sound. It is based on the interaction with physical and tangible elements (passive objects that children can organize and move inside a two-axis space). A tablet based app uses computer-vision procedures to recognize each object and its position and movement to playback audio files and modify different sound parameters in real time. The technological approach and design adopted according to the philosophy and objectives of the Touch the Sound project has proved to be effective, despite the drawbacks and technical problems encountered during the development process. Programming based on native Android OS tools has enabled the design of a system that achieves optimal performance results on devices with limited hardware resources. The system contributes to the media literacy of children, making them aware of the narrative possibilities of sound, and teaching them to control and modify its parameters.

Details

Publication
Journal of the Audio Engineering Society
Volume
66
Issue
6
Pages
478–485
Publication date
June 6, 2018
Affiliation
Universidad Loyola Andalucía, Seville, Spain (See document for exact affiliation information.)
Type
Journal Article