A Sonification of Cross-Cultural Differences in Happiness-Related Tweets

Liew K, Lindborg P. A Sonification of Cross-Cultural Differences in Happiness-Related Tweets. J Audio Eng Soc. 2020;68(1/2):25-33. doi:10.17743/jaes.2019.0056

@article{Liew2020_20715,
  author = {Liew, Kongmeng and Lindborg, PerMagnus},
  title = {{A Sonification of Cross-Cultural Differences in Happiness-Related Tweets}},
  journal = {Journal of the Audio Engineering Society},
  volume = {68},
  number = {1/2},
  pages = {25--33},
  year = {2020},
  month = jan,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2019.0056},
  url = {https://doi.org/10.17743/jaes.2019.0056}
}

TY  - JOUR
TI  - A Sonification of Cross-Cultural Differences in Happiness-Related Tweets
AU  - Liew, Kongmeng
AU  - Lindborg, PerMagnus
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 68
IS  - 1/2
SP  - 25
EP  - 33
PY  - 2020
DA  - 2020/01/06
DO  - 10.17743/jaes.2019.0056
UR  - https://doi.org/10.17743/jaes.2019.0056
PB  - Audio Engineering Society
LA  - en
AB  - Sonification can be defined as any technique that translates data into non-speech sound with a systematic, describable, and reproducible method, in order to reveal or facilitate communication, interpretation, or discovery of meaning that is latent in the data. This paper describes an approach for communicating cross-cultural differences in sentiment data through sonification, which is a powerful technique for the translation of patterns into sounds that are understandable, accessible, and musically pleasant. A machine-learning classifier was trained on sentiment information of two samples of Tweets from Singapore and New York with the keyword of "happiness." Positive-valence words that relate to the concept of happiness showed stronger influences on the classifier than negative words. For mapping, Tweet frequency differences of the semantic variable "anticipation" affected tempo, positive-affected pitch, and joy-affected loudness, while "trust" affected rhythmic regularity. The authors evaluated sonification of the original data from the two cities, together with a control condition generated from random mappings in a listening experiment. Results suggest that the original was rated as significantly more pleasant.
ER  -