Phoneme Mappings for Online Vocal Percussion Transcription

Delgado Alejandro, Saitis C, Sandler M. Phoneme Mappings for Online Vocal Percussion Transcription. In: AES Convention 151. Audio Engineering Society; 2021. Paper 10529. Available from: https://aes.org/publications/elibrary-page/?id=21493

@inproceedings{DelgadoAlejandro2021_21493,
  author = {{Delgado Alejandro} and Saitis, Charalampos and Sandler, Mark},
  title = {{Phoneme Mappings for Online Vocal Percussion Transcription}},
  booktitle = {AES Convention 151},
  note = {Paper 10529},
  year = {2021},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21493}
}

TY  - CPAPER
TI  - Phoneme Mappings for Online Vocal Percussion Transcription
AU  - Delgado Alejandro
AU  - Saitis, Charalampos
AU  - Sandler, Mark
T2  - AES Convention 151
M1  - Paper 10529
PY  - 2021
DA  - 2021/10/06
UR  - https://aes.org/publications/elibrary-page/?id=21493
PB  - Audio Engineering Society
LA  - en
AB  - Vocal Percussion Transcription (VPT) aims at detecting vocal percussion sound events in a beatboxing performance and classifying them into the correct drum instrument class (kick, snare, or hi-hat). To do this in an online (real-time) setting, however, algorithms are forced to classify these events within just a few milliseconds after they are detected. The purpose of this study was to investigate which phoneme-to-instrument mappings are the most robust for online transcription purposes. We used three different evaluation criteria to base our decision upon: frequency of use of phonemes among different performers, spectral similarity to reference drum sounds, and classification separability. With these criteria applied, the recommended mappings would potentially feel natural for performers to articulate while enabling the classification algorithms to achieve the best performance possible. Given the final results, we provided a detailed discussion on which phonemes to choose given different contexts and applications.
ER  -