Opens in a new tab

AES E-Library

← Back to search

Journal Article

Inferring Artist Similarity From Social Media Content: The Instagram Case

Authors: Zanoni, Massimiliano; Sansoni, Giacomo; Lista, Davide; Rottondi, Cristina; Bianco, Andrea

Journal of the Audio Engineering Society · Volume 74 · Issue 6 · pp. 404–416 · June 2026

Abstract

In the last decade, digital technology and online platforms have revolutionized the music industry. Streaming services and social media have allowed artists to reach global audiences and curate personal, interactive relationships with fans. Traditionally, artist similarity has been assessed through audio analysis, but the industry shift necessitates new methods: social media offer a rich multimodal dataset for analyzing artist similarity, considering follower intersections, communication styles, and content types. This study investigates how Instagram behavior and content correlate with artists’ musical production. An early fusion approach combines visual and textual analysis via vision transformers and Bidirectional Encoder Representations from Transformers models, utilizing a Siamese neural network trained with triplet loss and cosine distance, in order to yield a high-dimensional representation of artist positions in an embedding space. Evaluation through accuracy, precision, and recall confirms that leveraging social media data to assess artist similarity leads to results comparable to those achieved by traditional audio-based models, thus highlighting the potential of social media analysis in understanding commonalities and differences among artists.

Details

Publication
Journal of the Audio Engineering Society
Volume
74
Issue
6
Pages
404–416
Publication date
June 8, 2026
Affiliation
Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy; Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy; Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy; Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy; Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy (See document for exact affiliation information.)
Type
Journal Article