Opens in a new tab

AES E-Library

← Back to search

Conference Paper

Visualizing and Controlling Sound with Graphical Interfaces

Authors: O'Sullivan, Liam; Boland, Frank

AES Conference: 41st International Conference: Audio for Games · Paper P2-4 · February 2011

Abstract

Developments in abstract representations of sound from the field of computer music have potential applications for designers of musical computer games. Research in cognition has identified correlations in the perceptions of visual objects and audio events; - experiments show that test subjects associate certain qualities of graphical shapes with those of vocal sounds. Such 'sound symbolism' has been extended to non-vocal sounds and this paper describes attempts to exploit this and other phenomenon in the visualization of audio. The ideas are expanded upon to propose control for sound synthesis through the manipulation of virtual shapes. Mappings between parameters in the auditory and visual feedback modes are discussed. An exploratory user test examines the technique using a prototype system.

Details

Published in
AES Conference: 41st International Conference: Audio for Games
Paper number
P2-4
Publication date
February 6, 2011
Session subject
Audio for Games
Affiliation
Trinity College Dublin, Dublin, Ireland (See document for exact affiliation information.)
Type
Conference Paper