Chromesthesia Visualization Project

Chromesthesia is a form of synesthesia in which auditory stimuli evoke the perception of color. Current research focuses on how these sensory systems are activated and interact, but places less emphasis on visualizing the visceral experience itself.

​

This chromesthesia visualizer addresses that gap by allowing users to input ANY audio track and generate a unique, synchronized visualization. Audio features, including pitch, loudness, and timbre, are extracted via machine learning and mapped to corresponding visual features: hue, size, and shape. Different hues correspond to notes within an octave, with increasing brightness across higher octaves. String instruments are mapped to sine waves, percussive elements to circles, and sharper sounds to diamonds. The fade speed of each shape is determined by the harmonic content of each audio frame. A Gaussian blur is applied to evoke a naturalistic effect, akin to specks of light.

Further description and process of its making can be found HERE