Decoding Emotions: Lexical and Acoustical Cues in Vocal Affects

Oh E, Suhr J. Decoding Emotions: Lexical and Acoustical Cues in Vocal Affects. In: Convention Paper. Audio Engineering Society; 2024. Paper 10181. Available from: https://aes.org/publications/elibrary-page/?id=22684

@inproceedings{Oh2024_22684,
  author = {Oh, Eunmi and Suhr, Jinsun},
  title = {{Decoding Emotions: Lexical and Acoustical Cues in Vocal Affects}},
  note = {Paper 10181},
  year = {2024},
  month = sep,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=22684}
}

TY  - CPAPER
TI  - Decoding Emotions: Lexical and Acoustical Cues in Vocal Affects
AU  - Oh, Eunmi
AU  - Suhr, Jinsun
M1  - Paper 10181
PY  - 2024
DA  - 2024/09/27
UR  - https://aes.org/publications/elibrary-page/?id=22684
PB  - Audio Engineering Society
LA  - en
AB  - This study investigated listeners ability to detect emotions from a diverse set of speech samples, including spontaneous conversations and actor-posed speech. The study explored the influence of lexical content and acoustic properties when native listeners rated seven pairs of affective attributes. Two experimental conditions were employed: a text condition where participants evaluated emotional attributes from written transcripts without vocal information, and a voice condition where participants listened to audio recordings to assess emotions. The results showed that the importance of lexical and vocal cues varied across 14 affective states of posed and spontaneous speech. Vocal cues enhanced expressions of sadness and anger, but had less impact on conveying happiness in posed speech. Vocal cues tended to mitigate the negative emotions conveyed by lexical content in spontaneous speech. Further, correlational analyses revealed that lexical meanings suggesting anger or hostility could be interpreted as positive affective states such as intimacy or confidence. Linear regression analyses indicated that emotional ratings by listeners were predicted by up to 59% of lexical content and up to 26% of vocal cues. Listeners relied more on vocal cues to perceive emotions when the lexical content was ambiguous regarding feeling and attitude. Finally, the analysis identified statistically significant basic acoustic parameters and non/para-linguistic information after controlling for the effects of lexical content.
ER  -