What if Spiders Wove with Strings — hand-tracked audiovisual synth web

What if Spiders Wove with Strings — hand-tracked audiovisual synth web

An interactive piece by @pepepepebrick: MediaPipe hand tracking moves two digital spiders across an algorithmically generated 3D web in TouchDesigner, with VCV Rack making the sound. Legs grow near nodes and leg count drives pitch and effects, spider distance changes the waveform, and contact fuses the bodies and shifts color and web structure.

• Credits point to @blankensmithing's MediaPipe tooling for TouchDesigner • Map game-like state such as leg count and distance to synth parameters in VCV Rack • MediaPipe hand tracking in TouchDesigner drives both visuals and audio

MediaPipe, TouchDesigner, VCV Rack generative geometry, hand tracking, parameter mapping to sound

🧱 2026/04/09 • What if Spiders Wove with Strings?🕷️ 【如果蜘蛛可以用弦結網？】 • This is a hand-tracking audio and visual interactive system where users control digital spiders with their hands. At the center of the visual is a bio-inspired, algorithmically generated 3D web. As a spider’s body approaches the nodes, legs emerge and grow, where the number of legs modulates the pitch and effects—as if they were standing on musical strings. • The two spiders can interact, flirt, or engage in courtship, with their proximity altering the sound’s waveform. Upon physical contact, their bodies fuse together, triggering chemical transformations in their coloration and the web’s structure, while evoking deep resonant tones. • 這是一個手部追蹤的視覺與聲音互動系統，使用者可以透過雙手控制數位蜘蛛移動。畫面中間是一座仿生演算法產生的三維蜘蛛網，當蜘蛛的身體靠近節點時會生長出腳，腳的數量會對音高與效果器產…