Opens in a new tab

AES E-Library

← Back to search

Conference Paper Open Access

Measuring audio-visual speech intelligibility under dynamic listening conditions using virtual reality

Authors: Moore, Alastair H.; Green, Tim; Brookes, Mike; Naylor, Patrick A.

AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference · Paper 45 · August 2022

Abstract

The ELOSPHERES project is a collaboration between researchers at Imperial College London and University College London which aims to improve the efficacy of hearing aids. The benefit obtained from hearing aids varies significantly between listeners and listening environments. The noisy, reverberant environments which most people find challenging bear little resemblance to the clinics in which consultations occur. In order to make progress in speech enhancement, algorithms need to be evaluated under realistic listening conditions. A key aim of ELOSPHERES is to create a virtual reality-based test environment in which alternative speech enhancement algorithms can be evaluated using a listener-in-the-loop paradigm. In this paper we present the sap-elospheres-audiovisual-test (SEAT) platform and report the results of an initial experiment in which it was used to measure the benefit of visual cues in a speech intelligibility in spatial noise task.

Details

Published in
AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference
Paper number
45
Publication date
August 6, 2022
Session subject
Paper
Affiliation
Imperial College London, London, UK; University College London, London, UK (See document for exact affiliation information.)
Type
Conference Paper