Opens in a new tab

AES E-Library

← Back to search

Journal Article

Naviton—A Prototype Mobility Aid for Auditory Presentation of Three-Dimensional Scenes to the Visually Impaired

Authors: Bujacz, Michal; Skulimowski, Piotr; Strumillo, Pawel

Journal of the Audio Engineering Society · Volume 60 · Issue 9 · pp. 696–708 · September 2012

Abstract

To augment the task of navigation and orientation of blind individuals, a new travel aid uses 3D scene sonification to present information about the environment using nonverbal audio. The model is composed of two classes of objects: obstacles and planes. The algorithm uses scene image segmentation, personalized spatial audio, musical tones, and sonar-like sound patterns. Individually measured head-related transfer functions were used to provide users with the illusion of sounds originating from the locations of sonified scene elements. Using a segmented and parametric description overcomes the sensory mismatch between visual and auditory perception. In a pilot study using both blind and sighted volunteers, subjects were able to utilize the prototype for spatial orientation and obstacle avoidance after a few minutes of training, attaining 90% accuracy in estimating the direction and depth of obstacles.

Details

Publication
Journal of the Audio Engineering Society
Volume
60
Issue
9
Pages
696–708
Publication date
September 6, 2012
Affiliation
Lodz University of Technology, Lodz, Poland (See document for exact affiliation information.)
Type
Journal Article