tblankensmith patreon

Generate AI Images with Stable Diffusion + Audio Reactive Particle Effects - TouchDesigner Tutorial

🕑 Added 2022-12-20 06:48:54 +0000 UTC

Comments

Beatrice

having the same issue, did you find what causes this?

Chee Ming Wong

i try to follow the tutorial 100% , but unfortunately the outcome is totally difference than what's in the tutorial ,there are way too many black particles than the original tutorial ,may i know why?

JJ Wiesler

Ok. I've gotten most of this going. Quick follow up. Best way to programaticaly pulse the Computerender (Seems like it needs a new Seed # value to produce a new image). I have a button going to the Pulse on computerender so I can Pulse it manually. Can I replace that with ChopExecute Dat? Thank you!

JJ Wiesler

Thanks so much!

Torin Blankensmith

Hey! The particle system will work if you pass any TOP into it, so it's already setup for real-time. Try connecting the output of the ComputerRender into it. For audio reactivity it'd look nice to pass the channel Low, Mid or High onto the particles_gpu_2022 component for it's Speed parameter in the Settings Tab. You can always place a Lag CHOP in-between. If you want to configure the Computerender component to continuously generate Note that there's a channel called 'loading' that will tell you when Computerender is finished downloading / generating an image. You can create a CHOPExecute DAT to listen to these changes. When it's done loading you can programmatically pulse the Computerender component to generate a new image

JJ Wiesler

I have the same question! Getting the audio is, as described above works well, but how can the image generation and particle system be evolved to work in realtime?

Deakin Taggart

Hi Torin! Great work - I love the potential here. I'm trying to find a way to make the full project live. Along with live audio in, any thoughts on how to generate the images live so that prompts can be added during the performance or extend for time not limited by the recording? I understand there is the delay as a new image is created but perhaps there is a method for rolling/queueing generation? Would love your thoughts. Thanks!

Carlo C

Thanks!!

Torin Blankensmith

Hey if you're looking to get Audio from your Serato DJ into your computer you'll need an audio interface connected to your computer. These Scarlett devices work well: https://us.focusrite.com/products/scarlett-solo-refurbished?setCurrencyId=2&gclid=Cj0KCQjwxuCnBhDLARIsAB-cq1rxahYcKQe9t8Yv_H-GJOpeq15YsxmQBRkt2waUSDARNLuTACq3uYQaAh5jEALw_wcB You can then put down an AudioDeviceInCHOP in TouchDesigner and use the audio reactivity from that