The study presented here explores the perceived visual-auditory (VA) coherence between acoustic environments and their visual representations, addressing two main questions: are we able to associate room acoustics with their own visual representations, and does the type of visual rendering affect this judgment? A virtual reality (VR) experiment was conducted with five acoustic environments auralized through a Higher Order Ambisonics (HOA) multichannel system, each presented along with three types of visual representations: 360 photos, textured point clouds, and simple 3D models, rendered through a VR headset. For each VA condition, participants were asked to answer a simple question: "Do you think the sound you are hearing was produced in the environment you are seeing? Y/N." Results indicated that congruent situations were not consistently perceived as coherent, and the type of visual rendering did not influence judgments. These findings have implications for applications in cinema, video games, architectural simulation, and virtual reality.
(See document for exact affiliation information.)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
