Opens in a new tab

AES E-Library

← Back to search

Conference Paper

A Knowledge Representation Framework for Context-Dependent Audio Processing

Authors: Fazekas, Gyorgy; Wilmering, Thomas; Sandler, Mark

AES Conference: 42nd International Conference: Semantic Audio · Paper 8-2 · July 2011

Abstract

This paper presents a general framework for using appropriately structured information about audio recordings in music processing, and shows how this framework can be utilised in multitrack music production tools. The information, often referred to as metadata, is commonly represented in a highly domain and application specific format. This prevents interoperability and its ubiquitous use across applications. In this paper, we address this issue. The basis for the formalism we use is provided by Semantic Web ontologies rooted in formal logic. A set of ontologies are used to describe structured representation of information such as tempo, the name of instruments or onset times extracted from audio. This information is linked to audio tracks in music production environments as well as processing blocks such as audio effects. We also present specific case studies, for example, the use of audio effects capable of processing and predicting metadata associated with the processed signals. We show how this increases the accuracy of description, and reduces the computational cost, by omitting repeated application of feature extraction algorithms.

Details

Published in
AES Conference: 42nd International Conference: Semantic Audio
Paper number
8-2
Publication date
July 6, 2011
Session subject
Intelligent Audio Effects
Affiliation
Queen Mary University of London, London, UK (See document for exact affiliation information.)
Type
Conference Paper