Opens in a new tab

AES E-Library

← Back to search

Journal Article

Separation of Harmonic Musical Instrument Notes Using Spectro-Temporal Modeling of Harmonic Magnitudes and Spectrogram Inversion with Phase Optimization

Authors: Gunawan, David; Sen, Deep

Journal of the Audio Engineering Society · Volume 60 · Issue 12 · pp. 1004–1014 · December 2012

Abstract

Separating the individual sources in a single channel is particularly difficult because of overlapping harmonics. Western music is often arranged so that sounds are not only occurring simultaneously, but are also harmonically related. While traditional approaches use either spectral or temporal models, the proposed model exploits the combination of the spectral and temporal correlations of harmonic magnitudes to estimate the regions of overlap. A diverse selection of harmonic musical instruments was analyzed, and a generalized-instrument magnitude track prediction model was derived to generate track estimates. This approach, which exploits dependencies among tracks, was shown to be consistently more accurate than existing methods.

Details

Publication
Journal of the Audio Engineering Society
Volume
60
Issue
12
Pages
1004–1014
Publication date
December 6, 2012
Affiliation
University of New South Wales, Sydney, NSW, Australia (See document for exact affiliation information.)
Type
Journal Article