Automating sound design for adaptive video game narration

Vryzas N, Vrysis L, Eirini Stamatiadou M, Dimoulas C, Kalliris G. Automating sound design for adaptive video game narration. In: Express Paper. Audio Engineering Society; 2026. Paper 420. Available from: https://aes.org/publications/elibrary-page/?id=23153

@inproceedings{Vryzas2026_23153,
  author = {Vryzas, Nikolaos and Vrysis, Lazaros and Eirini Stamatiadou, Marina and Dimoulas, Charalampos and Kalliris, George},
  title = {{Automating sound design for adaptive video game narration}},
  note = {Paper 420},
  year = {2026},
  month = may,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=23153}
}

TY  - CPAPER
TI  - Automating sound design for adaptive video game narration
AU  - Vryzas, Nikolaos
AU  - Vrysis, Lazaros
AU  - Eirini Stamatiadou, Marina
AU  - Dimoulas, Charalampos
AU  - Kalliris, George
M1  - Paper 420
PY  - 2026
DA  - 2026/05/28
UR  - https://aes.org/publications/elibrary-page/?id=23153
PB  - Audio Engineering Society
LA  - en
AB  - HAMLET is a research project that investigates the integration of Artificial Intelligence and co-creation practices within the creative industries. The project proposes AI-driven enablers to support artists through collaborative workflows between creative practitioners and technology providers. This work focuses on an automated sound design framework for text-based role-playing games, where the game narration is dynamically generated through player textual interaction with an LLM. To address this unpredictability, the proposed system generates adaptive soundscapes automatically from textual scene descriptions. An LLM identifies semantically relevant sound sources, which are then matched to audio libraries through metadata alignment. The files are assessed for quality, and are fed to an automated mixing module. The framework addresses challenges related to semantic alignment, audio quality, aesthetic balance, and file size constraints.
ER  -