Designing a Augmented Reality Auditory Training Game for in-situ training and diagnostic tool for the hearing impaired

Koh P, Kim S. Designing a Augmented Reality Auditory Training Game for in-situ training and diagnostic tool for the hearing impaired. In: AES Conference: AES 2024 International Audio for Games Conference. Audio Engineering Society; 2024. Paper 16. Available from: https://aes.org/publications/elibrary-page/?id=22403

@inproceedings{Koh2024_22403,
  author = {Koh, Pooseung and Kim, Sungyoung},
  title = {{Designing a Augmented Reality Auditory Training Game for in-situ training and diagnostic tool for the hearing impaired}},
  booktitle = {AES Conference: AES 2024 International Audio for Games Conference},
  note = {Paper 16},
  year = {2024},
  month = apr,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22403}
}

TY  - CPAPER
TI  - Designing a Augmented Reality Auditory Training Game for in-situ training and diagnostic tool for the hearing impaired
AU  - Koh, Pooseung
AU  - Kim, Sungyoung
T2  - AES Conference: AES 2024 International Audio for Games Conference
M1  - Paper 16
PY  - 2024
DA  - 2024/04/06
UR  - https://aes.org/publications/elibrary-page/?id=22403
PB  - Audio Engineering Society
LA  - en
AB  - The World Health Organization reports that around 20% of the global population is affected by hearing impairment, a trend expected to only grow in the foreseeable future. Consequently, the development of accessible auditory training modules and diagnostic tools has become increasingly vital. In response, we propose an innovative Aug-mented Reality (AR)-based auditory training game that serves as an comprehensive auditory training/rehabilitation application for improving speech in noise perception and sound localization. Leveraging advancements in AR technology and mobile device computing power, our game incorporates audio-motor function into traditionally static training environments, with a design that focuses on enhancing selective auditory attention. The game challenges users to discriminate between two similarly pronounced words and identify the correct one in context, providing a novel approach to auditory training. A distinctive feature of our game is its ability to track the user’s movement relative to spatial audio sources. This tracking can provide valuable data for medical professionals, as the movements are visualized to a 2d mapping of their navigational data, revealing insights into the user’s auditory processing capabilities. Future work will assess the game’s training efficacy and its effectiveness as a diagnostic tool, alongside further enhancements to its auditory AR capabilities for real-time acoustic environment simulation.
ER  -