Convention Paper
Do You See What I Hear? An Artificial Chromesthetic Experience
AES Convention 150 · Paper 10462 · May 2021
Abstract
The scientific and experiential relationship of color and sound frequency has long been a topic of academic interest within the arts. Specifically, color has been recognized as a descriptive mechanism for music. For centuries, composers, musicians, and technical artists have relied, to varying degree, on the use of color as a semantical tool to distinguish emotional intent for a variety of musical events. The aim of this project is to prototype a system for real-time frequency conversion from audible sound to visible light, and use such a system to quantitatively enhance the qualitative musical performance. This system will be considered an artificial method of simulating sound to color synesthesia, otherwise known as chromesthesia. This prototype will act as a foundation to plausibly show that a measurable and scientifically definable relationship exists between the aural and visual spectra.
