Opens in a new tab

AES E-Library

← Back to search

Journal Article

Scenes and Images into Sounds: A Taxonomy of Image Sonification Methods for Mobility Applications

Authors: Sanz, Pablo Revuelta; Mezcua, Belén Ruiz; Pena, José M. Sánchez; Walker, Bruce N.

Journal of the Audio Engineering Society · Volume 62 · Issue 3 · pp. 161–171 · March 2014

Abstract

Sonification is the systematic representation of data using sounds, such as text-to-speech, color readers, Geiger counters, acoustic radars, and MIDI synthesizers. This paper surveys existing sonification systems and suggests taxonomy of algorithms and devices. The sonification process requires an artificial mapping between two sensory modalities using a model based on either psychoacoustics or artificial heuristics. In the former, the paradigm exploits the natural discrimination of the source spatial parameters (distance, azimuth, and elevation, for instance). In the latter, the paradigm creates an artificial match between graphical and auditory cues. Artificial sonification uses nonspatial characteristics of the sound, such as frequency, brightness or timbre, formants, saturation, and time intervals, which are not related to the physical characteristics or parameters of objects or surroundings.

Details

Publication
Journal of the Audio Engineering Society
Volume
62
Issue
3
Pages
161–171
Publication date
March 6, 2014
Affiliation
Carlos III University of Madrid, Lega, Spain; GeorgiaTech, Atlanta, GA, USA (See document for exact affiliation information.)
Type
Journal Article