Opens in a new tab

AES E-Library

← Back to search

Conference Paper

Do You See What I Hear? An Artificial Chromesthetic Experience

Authors: Earle, Michael W.

AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020) · Paper 10462 · August 2020

Abstract

The scientific and experiential relationship of color and sound frequency has long been a topic of academic interest within the arts. Specifically, color has been recognized as a descriptive mechanism for music. For centuries, composers, musicians, and technical artists have relied, to varying degree, on the use of color as a semantical tool to distinguish emotional intent for a variety of musical events. The aim of this project is to prototype a system for real-time frequency conversion from audible sound to visible light, and use such a system to quantitatively enhance the qualitative musical performance. This system will be considered an artificial method of simulating sound to color synesthesia, otherwise known as chromesthesia. This prototype will act as a foundation to plausibly show that a measurable and scientifically definable relationship exists between the aural and visual spectra.

Details

Published in
AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020)
Paper number
10462
Publication date
August 6, 2020
Session subject
AV Art
Affiliation
Houghton College, Hougton, NY, USA; State University of New York at Fredonia, USA (See document for exact affiliation information.)
Type
Conference Paper