Toward Emotionally-Congruent Dynamic Soundtrack Generation

Williams D. Toward Emotionally-Congruent Dynamic Soundtrack Generation. J Audio Eng Soc. 2016;64(9):654-663. doi:10.17743/jaes.2016.0038

@article{Williams2016_18374,
  author = {Williams, Duncan},
  title = {{Toward Emotionally-Congruent Dynamic Soundtrack Generation}},
  journal = {Journal of the Audio Engineering Society},
  volume = {64},
  number = {9},
  pages = {654--663},
  year = {2016},
  month = sep,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2016.0038},
  url = {https://doi.org/10.17743/jaes.2016.0038}
}

TY  - JOUR
TI  - Toward Emotionally-Congruent Dynamic Soundtrack Generation
AU  - Williams, Duncan
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 64
IS  - 9
SP  - 654
EP  - 663
PY  - 2016
DA  - 2016/09/06
DO  - 10.17743/jaes.2016.0038
UR  - https://doi.org/10.17743/jaes.2016.0038
PB  - Audio Engineering Society
LA  - en
AB  - Real-time control of the emotional content of sound has utility in video game soundtracking where the player controls the narrative trajectory, and the affective attributes of the sound should ideally match this trajectory. Perceived emotions can be represented in a 2-dimensional space composed of valence (positivity, e.g. happy, sad, fearful) and arousal (intensity, e.g. mild vs strong). This report is a speculative exploration of measuring and manipulating sound effects to achieve emotional congruence. An initial study suggests that timbral features can exert an influence on the perceived emotional response of a listener. A panel of listeners responded to stimuli in a set with varying timbres, while maintaining pitch, loudness, and other musical and acoustic features such as key, melodic contour, rhythm and meter, reverberant environment etc. The long term goal is to create an automated system that utilizes timbre morphing in real time to manipulate perceived affect in soundtrack generation.
ER  -