AES E-Library

← Back to search

Conference Paper

Investigation of Cross-Modal Relationships Between Visual Color and Auditory Elevation

Authors: Treanor, Garrett; Songmuang, Parichat; Sall, Catherine; Tsuaye, Jeremy

AES Show 2026 Nashville · Paper 18 · October 2026

Abstract

Cross-modal relationships, wherein stimuli isolated to a single faculty elicit a reaction associated with another, are integral to helping us form a complete context of the world around us with incomplete information. Larger
objects are consistently linked with lower pitches, and vice versa. In a famous example, the word "bouba" has a greater tendency to be conferred upon rounded shapes, while "kiki" has a greater tendency to be conferred upon jagged shapes. Prior work has established cross-modal relationships between pitch and color, and between pitch and perceived elevation. Using pitch as a logical bridge, it is therefore hypothesized that a meaningful cross-modal relationship exists between color and perceived elevation. With a focus on the evaluation of such a relationship, preliminary subjective testing results are examined and evaluated against the presented methodology.

Details

Published in
AES Show 2026 Nashville
Paper number
18
Publication date
October 30, 2026
Session subject
Audio for MultimediaImmersive & Spatial Audio: Simulation & EvaluationPsychoacoustics
Affiliation
New York University; New York University (See document for exact affiliation information.)
Type
Conference Paper

Save to list