Integrating AI and custom shaders directly into real-time visual performances

Integrating AI and custom shaders directly into real-time visual performances

RNA Studio, Lisbon
Oct 7 / 2026 · by
Dimitri De Jonghe

free workshop  - Register here luma.com/rnastudio 

Powered by TouchDesigner

 

This session focuses on integrating AI and custom shaders directly into real-time visual performances. Participants will learn the fundamentals of GLSL and how to drive generative diffusion models natively inside TouchDesigner using live audio signals. The workshop culminates in a collaborative joint session that bridges the gap between traditional interactive inputs and AI-generated outputs.

 

What participants will see and learn

  • StreamDiffusion: Real-time AI image generation inside TouchDesigner.
  • Audio-Driven AI: Audio reactivity applied to generative and diffusion pipelines.
  • Shader Basics: Shaders / GLSL fundamentals.
  • System Integration: A joint session combining audio-reactive and depth-camera inputs with diffusion and shader outputs into one working chain.

 

End of Day Outcome Participants will leave with a clear understanding of how to bridge multiple advanced techniques within TouchDesigner. By combining earlier audio-reactive and depth-camera systems with real-time AI diffusion and GLSL shaders, attendees will successfully build and manage one unified, working chain.

About the Facilitator
Dimitri De Jonghe is a creative technologist and the founder of 204.ai, a creative technology studio leading in immersive, AI-driven interactive design in Europe. His work explores the bleeding edge of interactive art by combining generative AI, real-time rendering engines, and advanced computational workflows to transform static spaces into deeply participatory, reactive environments.


 

Share on