Opens in a new tab

AES E-Library

← Back to search

Conference Paper

A Framework to Provide Fine-Grained Time-Dependent Context for Active Listening Experiences

Authors: Six, Joren; Leman, Marc

AES Conference: 2017 AES International Conference on Semantic Audio · Paper P1-5 · June 2017

Abstract

This work presents a system that is able to provide fine-grained time-dependent context while listening to recorded music. By utilizing acoustic fingerprinting techniques the system recognizes which music is playing in the environment and also determines an exact playback position. This makes it possible to provide context at exactly the right time. The design of the system can be used to augment listening experiences with lyrics, scores, tablature or even music videos. To test the concept, a prototype has been built that is able to give feedback that coincides with the beat of music playing in the users environment. The system is evaluated with respect to timing and is able to respond to beats within 16 ms on average.

Details

Published in
AES Conference: 2017 AES International Conference on Semantic Audio
Paper number
P1-5
Publication date
June 6, 2017
Session subject
Semantic Audio
Affiliation
Ghent University, Ghent, Belgium (See document for exact affiliation information.)
Type
Conference Paper