Opens in a new tab

AES E-Library

← Back to search

Journal Article

Soundscape Audio Signal Classification and Segmentation Using Listeners Perception of Background and Foreground Sound

Authors: Thorogood, Miles; Fan, Jianyu; Pasquier, Philippe

Journal of the Audio Engineering Society · Volume 64 · Issue 7/8 · pp. 484–492 · July 2016

Abstract

A soundscape recording captures the sonic environment at a given location at a given time using one or more fixed or moving microphones. In most cases, the soundscape is uncontrolled and unscripted. Human listeners experience sonic components as being either background or foreground depending on their salient perceptual characteristics, such as proximity, repetition, and spectral attributes. Analyzing soundscapes in research tasks requires the classification and segmentation of the important sonic components, but that process is time consuming when done manually. This research establishes the background and foreground classification task within a musicological and soundscape context and then presents a method for the automatic segmentation of soundscape recordings. Using a soundscape corpus with ground truth data obtained from a human perception study, the analysis shows that participants have a high level of agreement on the category assigned to background samples (92.5%), foreground samples (80.8%), and background with foreground samples (75.3%). Experiments demonstrate how smaller window sizes affect the performance of the classifier.

Details

Publication
Journal of the Audio Engineering Society
Volume
64
Issue
7/8
Pages
484–492
Publication date
July 6, 2016
Affiliation
Simon Fraser University, SIAT, Canada (See document for exact affiliation information.)
Type
Journal Article