Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Augmented Reality to Improve Orchestra Conductors’ Headphone Monitoring

Authors: Soudoplatoff, Dimitri; Pras, Amandine

AES Convention 142 · Paper 9720 · May 2017

Abstract

Conductors face challenges when conducting the orchestra with headphones to synchronize with a soundtrack or a click track. We sent a survey to 12 international conductors to identify and classify those challenges. They primarily reported on balance issues, aggressive click tracks, and the difficulty of hearing the acoustic sound of the orchestra, leading 70% of them to remove one ear out of the headphones. A solution using augmented reality monitoring through binaural rendering and head tracking was tested in various situations and showed that it could successfully reproduce the acoustic sound of the orchestra into the headphones. Another perceptual experiment evaluated the potential of realism of this solution when merging two binaural auditory scenes recorded in the same acoustic space together. Results encourage us to further develop immersive monitoring systems for conductors, with the soundtrack integrated in the real acoustic space.

Details

Published in
AES Convention 142
AES Convention
142
Paper number
9720
Publication date
May 6, 2017
Session subject
Spatial Audio—Binaural 3 and Objects
Affiliation
Conservatoire National Supérieur de Musique et de Danse de Paris (CNSMDP), Paris, France; University of Lethbridge, Lethbridge, AB, Canada (See document for exact affiliation information.)
Type
Convention Paper