Singing Voice Separation from Stereo Recordings Using Spatial Clues and Robust F0 Estimation

Cabañas-Molero P, Martínez Muñoz D, Cobos M, López JJ. Singing Voice Separation from Stereo Recordings Using Spatial Clues and Robust F0 Estimation. In: AES Conference: 42nd International Conference: Semantic Audio. Audio Engineering Society; 2011. Paper 5-1. Available from: https://aes.org/publications/elibrary-page/?id=15965

@inproceedings{CabanasMolero2011_15965,
  author = {Cabañas-Molero, Pablo and Martínez Muñoz, Damián and Cobos, Maximo and López, José J.},
  title = {{Singing Voice Separation from Stereo Recordings Using Spatial Clues and Robust F0 Estimation}},
  booktitle = {AES Conference: 42nd International Conference: Semantic Audio},
  note = {Paper 5-1},
  year = {2011},
  month = jul,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=15965}
}

TY  - CPAPER
TI  - Singing Voice Separation from Stereo Recordings Using Spatial Clues and Robust F0 Estimation
AU  - Cabañas-Molero, Pablo
AU  - Martínez Muñoz, Damián
AU  - Cobos, Maximo
AU  - López, José J.
T2  - AES Conference: 42nd International Conference: Semantic Audio
M1  - Paper 5-1
PY  - 2011
DA  - 2011/07/06
UR  - https://aes.org/publications/elibrary-page/?id=15965
PB  - Audio Engineering Society
LA  - en
AB  - Separation of singing voice from music accompaniment is a topic of great utility in many application of Music Information Retrieval. In the context of stereophonic music mixtures, many algorithms face this problem making use of the spatial diversity of the sound sources to localize and isolate the singing voice. Although these spatial approaches can obtain acceptable results, the separated signal usually is affected by a high level of distortions and artifacts. In this paper, we propose a method for improving the isolation of the singing voice in stereo recordings based on incorporating the fundamental frequency (F0) information to the separation process. First, the singing voice is pre-separated from the input mixture using a state-of-the-art stereo source separation method, the MuLeTs algorithm. Then, the F0 of this pre-separated signal is obtained using a robust pitch estimator based on the computation of the difference function and Hidden Markov Models, obtaining a smooth pitch contour with voiced/unvoiced decisions. A binary mask is finally constructed from F0 to isolate the singing voice from the original mix. The method has been tested on studio music recordings, obtaining good separation results.
ER  -