Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Audio Source Localization as an Input to Virtual Reality Environments

Authors: Kerure, Agneya A.; Freeman, Jason

AES Convention 144 · Paper 10019 · May 2018

Abstract

This paper details an effort towards incorporating audio source localization as an input to virtual reality systems, focusing primarily on games. The goal of this research is to find a novel method to use localized live audio as an input for level generation or creation of elements and objects in a virtual reality environment. The paper discusses the current state of audio-based games and virtual reality, and details the design requirements of a system consisting of a circular microphone array that can be used to localize the input audio. The paper also briefly discusses signal processing techniques used for audio information retrieval and introduces a prototype of an asymmetric virtual reality first-person shooter game as a proof-of-concept of the potential of audio source localization for augmenting the immersive nature of virtual reality.

Details

Published in
AES Convention 144
AES Convention
144
Paper number
10019
Publication date
May 6, 2018
Session subject
Posters: Spatial Audio
Affiliation
Georgia Institute of Technology, Atlanta, GA, USA (See document for exact affiliation information.)
Type
Convention Paper