HoloBand: An Augmented Reality Experience to Train Music Perception for the Hard of Hearing

Ivanyi B, Tsalidis C, Naylor S, Tjemsland T, Adjorlu A, Kepp NE, Serafin S. HoloBand: An Augmented Reality Experience to Train Music Perception for the Hard of Hearing. In: AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference. Audio Engineering Society; 2022. Paper 1. Available from: https://aes.org/publications/elibrary-page/?id=21831

@inproceedings{Ivanyi2022_21831,
  author = {Ivanyi, Balazs and Tsalidis, Christian and Naylor, Scott and Tjemsland, Truls and Adjorlu, Ali and Kepp, Nille Elise and Serafin, Stefania},
  title = {{HoloBand: An Augmented Reality Experience to Train Music Perception for the Hard of Hearing}},
  booktitle = {AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference},
  note = {Paper 1},
  year = {2022},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21831}
}

TY  - CPAPER
TI  - HoloBand: An Augmented Reality Experience to Train Music Perception for the Hard of Hearing
AU  - Ivanyi, Balazs
AU  - Tsalidis, Christian
AU  - Naylor, Scott
AU  - Tjemsland, Truls
AU  - Adjorlu, Ali
AU  - Kepp, Nille Elise
AU  - Serafin, Stefania
T2  - AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference
M1  - Paper 1
PY  - 2022
DA  - 2022/08/06
UR  - https://aes.org/publications/elibrary-page/?id=21831
PB  - Audio Engineering Society
LA  - en
AB  - HoloBand is a clinical tool for audiovisual music perception training in augmented reality (AR) using the Hololens 2 for the hard-of-hearing (HoH). It consists of two interfaces: a spatial environment in AR for the HoH user and a computer interface to control the training for speech and language pathologists (SLP). We adopt a participatory exploratory research approach to investigate novel ways of conducting timbre discrimination, audio localization, and pitch recognition. HoloBand is evaluated using a focus group with SLPs (n=6) and interpreted through inductive thematic analysis. Hololens 2 shows relevant contextual, visual capabilities to enhance music perception training. However, a closer integration into the clinical workflow and a task-oriented approach is necessary to bring real-life scenarios to the clinical setting.
ER  -