Multimodal Exploration of Virtual Objects with a Spatialized Anchor Sound

Geronazzo M, Bedin A, Brayda L, Avanzini F. Multimodal Exploration of Virtual Objects with a Spatialized Anchor Sound. In: AES Conference: 55th International Conference: Spatial Audio. Audio Engineering Society; 2014. Paper P-1. Available from: https://aes.org/publications/elibrary-page/?id=17357

@inproceedings{Geronazzo2014_17357,
  author = {Geronazzo, Michele and Bedin, Alberto and Brayda, Luca and Avanzini, Federico},
  title = {{Multimodal Exploration of Virtual Objects with a Spatialized Anchor Sound}},
  booktitle = {AES Conference: 55th International Conference: Spatial Audio},
  note = {Paper P-1},
  year = {2014},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=17357}
}

TY  - CPAPER
TI  - Multimodal Exploration of Virtual Objects with a Spatialized Anchor Sound
AU  - Geronazzo, Michele
AU  - Bedin, Alberto
AU  - Brayda, Luca
AU  - Avanzini, Federico
T2  - AES Conference: 55th International Conference: Spatial Audio
M1  - Paper P-1
PY  - 2014
DA  - 2014/08/06
UR  - https://aes.org/publications/elibrary-page/?id=17357
PB  - Audio Engineering Society
LA  - en
AB  - A multimodal interactive system for audio-haptic integration is presented in this paper. Preliminary subjective tests with a virtual reality setup were conducted with the goal of interpreting cognitive mechanisms and improving performances in orientation & mobility protocols for visually impaired subjects, where spatial representations need to be developed using residual sensory channels. An object recognition experiment was performed in order to investigate the contribution of dynamic spatial audio cues when integrated with haptic feedback. Audio cues took the form of anchor sound delivered through headphones using customized Head-related Transfer Functions (HRTFs). This setup was employed in the exploration of simplified virtual audio-tactile environments. Overall results on recognition time reveal a relationship between anchor position and object shape. Moreover, a qualitative analysis of the exploration paths highlights behavioral changes between unimodal and multimodal conditions.
ER  -