A serious game for crowdsourcing and self-evaluating speech emotion annotated data

Siamtanidou E, Vryzas N, Vrysis L, Dimoulas C. A serious game for crowdsourcing and self-evaluating speech emotion annotated data. In: AES Convention 154. Audio Engineering Society; 2023. Paper 75. Available from: https://aes.org/publications/elibrary-page/?id=22100

@inproceedings{Siamtanidou2023_22100,
  author = {Siamtanidou, Eleni and Vryzas, Nikolaos and Vrysis, Lazaros and Dimoulas, Charalampos},
  title = {{A serious game for crowdsourcing and self-evaluating speech emotion annotated data}},
  booktitle = {AES Convention 154},
  note = {Paper 75},
  year = {2023},
  month = may,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22100}
}

TY  - CPAPER
TI  - A serious game for crowdsourcing and self-evaluating speech emotion annotated data
AU  - Siamtanidou, Eleni
AU  - Vryzas, Nikolaos
AU  - Vrysis, Lazaros
AU  - Dimoulas, Charalampos
T2  - AES Convention 154
M1  - Paper 75
PY  - 2023
DA  - 2023/05/06
UR  - https://aes.org/publications/elibrary-page/?id=22100
PB  - Audio Engineering Society
LA  - en
AB  - Speech Emotion Recognition (SER) systems have become indispensable tools in human-computer interaction, communication, and knowledge representation. Most SER systems are based on machine learning techniques and require large amounts of ground-truth data to be trained and achieve decent performance. This work presents a serious game and crowdsourcing techniques in the development and enhancement of SER models through the collection of annotating data. Serious games can contribute to and assist with this issue as a form of entertainment and informal education. In this direction, the online game "Raise Your Voice" was created, which enables the collection of recordings of emotionally charged speech in an accessible way, featuring a scheme of five distinct classes (anger, disgust, fear, happiness, and sadness). Using a web service architecture, speech emotion recognition is conducted during gameplay, helping players to evaluate and identify their effort. The main goal of the game is to attract users who will use this educational tool to express emotional speech through amusement and to create a mutually beneficial cooperative model between users and speech emotion recognition researchers.
ER  -