Multilayered Affect-Audio Research System for Virtual Reality Learning Environments

Olsen AF, Roginska A, Plass JL. Multilayered Affect-Audio Research System for Virtual Reality Learning Environments. In: AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference. Audio Engineering Society; 2022. Paper 19. Available from: https://aes.org/publications/elibrary-page/?id=21849

@inproceedings{Olsen2022_21849,
  author = {Olsen, Alvaro F and Roginska, Agnieszka and Plass, Jan L.},
  title = {{Multilayered Affect-Audio Research System for Virtual Reality Learning Environments}},
  booktitle = {AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference},
  note = {Paper 19},
  year = {2022},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21849}
}

TY  - CPAPER
TI  - Multilayered Affect-Audio Research System for Virtual Reality Learning Environments
AU  - Olsen, Alvaro F
AU  - Roginska, Agnieszka
AU  - Plass, Jan L.
T2  - AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference
M1  - Paper 19
PY  - 2022
DA  - 2022/08/06
UR  - https://aes.org/publications/elibrary-page/?id=21849
PB  - Audio Engineering Society
LA  - en
AB  - How does sound impact learners’ emotions? This is an important question because emotion plays an important role in learning. Research shows that confusion, frustration, boredom, engagement and interest are emotions experienced during complex learning [11][15]. Work in this area found that visual and audio materials can elicit emotions that influence the attention of learners [36]. In the current work, we focus on learner’s affect and sound design for virtual reality learning environments and present the design of the Multilayered Affect-Audio Research System, MAARS. We describe the sound design workflow, affective sound design heuristics, the audio presentation system and each of the operational components. The goal is to have a system that enables the rapid creation of auditory experimental conditions in VR in order to accelerate the research in this area and to help answer the question of how sound and its designs impact learners’ affective states and cognitive performance in virtual reality learning environments.
ER  -