Role

Visual Engineer, Audio Analyst

Tools

Touchdesigner, Resolume, OSC

Duration

3 weeks

Output

Reactive Projection Mapping

Date

September 2024

Bridge is an immersive audiovisual experiment where visual systems are not just reactive—but deeply synchronized with sound on a perceptual level. By merging TouchDesigner’s dynamic signal processing with Resolume’s real-time manipulation, the visuals act like an emotional twin of the audio experience. The Purpose and Vision of the project is to create an immersive audiovisual experience that evolves with the music.

TouchDesigner ↔ OSC ↔ Resolume Flow

“RMS power used as primary signal trigger”
“OSC setup to send switch control to Resolume”

Audio In → Spectrum → RMS → Value Mapping → OSC Out → Resolume

By designing OSC-reactive controls in Resolume, the visuals not only followed the audio but mimicked its intensity. Color grading and movement were dynamically altered by frequency zones and amplitude—resulting in layered visual reactions tied to specific emotional tones in the music.

“Visuals were mapped to irregular surfaces and everyday objects, transforming the bedroom into a dream-like reactive canvas.”

“This piece opened up deeper questions for me around the integration of ambient systems into everyday life. My goal is to make reactive systems feel like organic phenomena—where sound, light, and space blur into one cohesive presence.”

Bullet list:

  • Built TD patch with dynamic audio-reactive logic
  • Designed OSC bridge for hybrid visual manipulation
  • Developed projection calibration workflow
  • Explored perceptual theory (contrast vs subtlety)

The raw form of the animations are a part of the pack called “OrnaMental II” which is created by STVinmotion

TouchDesigner and Resolume developed a coherent visual flow where every graphic element matched the music’s vigour, creating a seamless and engaging experience. Real-time graphic adaption to music improved audiovisual presentation. Combining these formidable tools has perks and cons. The combination provides dynamic, adjustable graphics that match music. Visual trigger lag may require further adjustment to achieve perfect synchronisation, especially in live environments.