tblankensmith
patreon
Audio Reactive Animtions with Stable Diffusion and TouchDesigner
🕑 Added 2023-02-01 05:39:24 +0000 UTCHey! In this tutorial, we'll go over how to use Stable Diffusion with a custom component to generate audio-reactive animations in TouchDesigner.
Project File attached
Link to The first Tutorial: https://www.youtube.com/watch?v=mRXTR...
Link to the API: https://computerender.com/
Prompt Engineering with Lexica: https://lexica.art/
Opt out of Ai Training: https://haveibeentrained.com/
Huge thank you to Peter Whidden for his support on this and his work on Computerender which makes this project possible!!
Comments
Altnt
Hi! This looks so great! Just a question: I saw in your youtube video a short explanation on how to set up that cross (around 1:30) To crossfade between the new images generated. I have checked the project files but I can't find it anywhere! Do you have the project from the video? I would love to see it to learn how to setup a Chopexec to do that! Thanks! :)
David Fong
@Jana I've just started looking into that as well- I know Auto1111 can expose a local API, I just need to figure out how that API call differs from the Computerender setup
Jana Spacelight
Hey! Thanks sooo much for bringing me back to touchdesigner! am experimenting with Auto1111 deforum, and now I'm looking for a way to use it in TD. basically your workflow except the API. Thought I could combine yours and that one - or the next version with imgtoimg, but I'm stuck here :) https://www.youtube.com/c/VJSCHOOL?app=desktop Can you lead me in any direction?
