Dual Task Monophonic Singing Transcription

Schwabe M, Murgul S, Heizmann M. Dual Task Monophonic Singing Transcription. J Audio Eng Soc. 2022;70(12):1038-1047. doi:10.17743/jaes.2022.0040

@article{Schwabe2022_22025,
  author = {Schwabe, Markus and Murgul, Sebastian and Heizmann, Michael},
  title = {{Dual Task Monophonic Singing Transcription}},
  journal = {Journal of the Audio Engineering Society},
  volume = {70},
  number = {12},
  pages = {1038--1047},
  year = {2022},
  month = dec,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2022.0040},
  url = {https://doi.org/10.17743/jaes.2022.0040}
}

TY  - JOUR
TI  - Dual Task Monophonic Singing Transcription
AU  - Schwabe, Markus
AU  - Murgul, Sebastian
AU  - Heizmann, Michael
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 70
IS  - 12
SP  - 1038
EP  - 1047
PY  - 2022
DA  - 2022/12/06
DO  - 10.17743/jaes.2022.0040
UR  - https://doi.org/10.17743/jaes.2022.0040
PB  - Audio Engineering Society
LA  - en
AB  - Automatic music transcription with note level output is a current task in the field of music information retrieval. In contrast to the piano case with very good results using available large datasets, transcription of non-professional singing has been rarely investigated with deep learning approaches because of the lack of note level annotated datasets. In this work, two datasets are created concerning amateur singing recordings, one for training (synthetic singing dataset) and one for the evaluation task (SingReal dataset). The synthetic training dataset is generated by synthesizing a large scale of vocal melodies from artificial songs. Because the evaluation should represent a realistic scenario, the SingReal dataset is created from real recordings of non-professional singers. To transcribe singing notes, a new method called Dual Task Monophonic Singing Transcription is proposed, which divides the problem of singing transcription into the two subtasks onset detection and pitch estimation, realized by two small independent neural networks. This approach achieves a note level F1 score of 74.19% on the SingReal dataset, outperforming all state of the art transcription systems investigated with at least 3.5% improvement. Furthermore, Dual Task Monophonic Singing Transcription can be adapted very easily to the real-time transcription case.
ER  -