The Role of Lombard Speech and Gaze Behaviour in Multi-Talker Conversations

Dourado M, Hassager HG, Udesen J, Serafin S. The Role of Lombard Speech and Gaze Behaviour in Multi-Talker Conversations. In: AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference. Audio Engineering Society; 2022. Paper 22. Available from: https://aes.org/publications/elibrary-page/?id=21852

@inproceedings{Dourado2022_21852,
  author = {Dourado, Mark and Hassager, Henrik Gert and Udesen, Jesper and Serafin, Stefania},
  title = {{The Role of Lombard Speech and Gaze Behaviour in Multi-Talker Conversations}},
  booktitle = {AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference},
  note = {Paper 22},
  year = {2022},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21852}
}

TY  - CPAPER
TI  - The Role of Lombard Speech and Gaze Behaviour in Multi-Talker Conversations
AU  - Dourado, Mark
AU  - Hassager, Henrik Gert
AU  - Udesen, Jesper
AU  - Serafin, Stefania
T2  - AES Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference
M1  - Paper 22
PY  - 2022
DA  - 2022/08/06
UR  - https://aes.org/publications/elibrary-page/?id=21852
PB  - Audio Engineering Society
LA  - en
AB  - Effective communication with multiple conversational partners in cocktail party conditions can be attributed to successful auditory scene analysis. Talkers unconsciously adjust to adverse settings by introducing both verbal and non-verbal strategies, such as the Lombard effect. The Lombard effect has traditionally been defined as an increase in vocal intensity as a response to noise, with the purpose of increasing self-monitoring for the talker and intelli-gibility for conversational partners. To assess how the Lombard effect is utilized in multimodal communication, speech and gaze data were collected from four multi-talker groups with pre-established relationships. Each group had casual conversations in both quiet settings and scenarios with external babble noise. Results show that fifteen out of sixteen talkers exhibited an average increase in loudness during interruptive speech in all conditions with-and without external babble noise when compared to unchallenged sections of speech. Comparing gaze behavior during periods of a talkers own speech to periods of silence showed that the majority of talkers had more active gaze when speaking.
ER  -