Enhancing Data Quality and Optimizing Speech Emotion Recognition Systems through a Gamified Application

Siamtanidou E, Vryzas N, Vrysis L, Dimoulas C. Enhancing Data Quality and Optimizing Speech Emotion Recognition Systems through a Gamified Application. In: Express Paper. Audio Engineering Society; 2024. Paper 244. Available from: https://aes.org/publications/elibrary-page/?id=22590

@inproceedings{Siamtanidou2024_22590,
  author = {Siamtanidou, Eleni and Vryzas, Nikolaos and Vrysis, Lazaros and Dimoulas, Charalampos},
  title = {{Enhancing Data Quality and Optimizing Speech Emotion Recognition Systems through a Gamified Application}},
  note = {Paper 244},
  year = {2024},
  month = jun,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22590}
}

TY  - CPAPER
TI  - Enhancing Data Quality and Optimizing Speech Emotion Recognition Systems through a Gamified Application
AU  - Siamtanidou, Eleni
AU  - Vryzas, Nikolaos
AU  - Vrysis, Lazaros
AU  - Dimoulas, Charalampos
M1  - Paper 244
PY  - 2024
DA  - 2024/06/06
UR  - https://aes.org/publications/elibrary-page/?id=22590
PB  - Audio Engineering Society
LA  - en
AB  - Speech encompasses more than mere words; it incorporates paralinguistic elements that reflect language, personality, intention, and emotion. The rapid advancements in machine learning and deep learning technologies have led to significant strides in Speech Emotion Recognition (SER) systems, designed to detect and classify emotions in human speech. However, SER systems remain a challenging research area, necessitating substantial amounts of ground truth data for effective training and achieving satisfactory performance. To address these challenges, this study introduces a gamified application, augmented by crowdsourcing techniques, aimed at enhancing and apply SER models through the collection of annotated data. Specifically, the "J-PLUS" app offers three distinct modules tailored for learning and practicing emotional speech, catering to professional journalists, news anchors, and the general public. These modules encompass a serious game for interactive practice, authentic news content for professional education, and an emotional journal for personal expression. The overarching objectives of the application include enhancing user engagement, optimizing user experience, and supporting continuous practice and training endeavors.
ER  -