AES E-Library

Designing a Augmented Reality Auditory Training Game for in-situ training and diagnostic tool for the hearing impaired

The World Health Organization reports that around 20% of the global population is affected by hearing impairment, a trend expected to only grow in the foreseeable future. Consequently, the development of accessible auditory training modules and diagnostic tools has become increasingly vital. In response, we propose an innovative Aug-mented Reality (AR)-based auditory training game that serves as an comprehensive auditory training/rehabilitation application for improving speech in noise perception and sound localization. Leveraging advancements in AR technology and mobile device computing power, our game incorporates audio-motor function into traditionally static training environments, with a design that focuses on enhancing selective auditory attention. The game challenges users to discriminate between two similarly pronounced words and identify the correct one in context, providing a novel approach to auditory training. A distinctive feature of our game is its ability to track the user’s movement relative to spatial audio sources. This tracking can provide valuable data for medical professionals, as the movements are visualized to a 2d mapping of their navigational data, revealing insights into the user’s auditory processing capabilities. Future work will assess the game’s training efficacy and its effectiveness as a diagnostic tool, alongside further enhancements to its auditory AR capabilities for real-time acoustic environment simulation.

 

Author (s):
Affiliation: (See document for exact affiliation information.)
Publication Date:
Session subject:

DOI:


Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.

Type:
16938
Choose your country of residence from this list: