entagma
patreon
Advanced Setups 25 - Controlling Stable Diffusion With Houdini Pt. 3: ControlNet
🕑 Added 2023-03-16 10:00:02 +0000 UTCEDIT: Added updated scene file for new controlnet extension API calls
In part three of our small series on stable diffusion in Houdini, Mo uses Automatic1111’s API together with its controlnet extension to build a “render engine” based on AI.
Comments
Tomas Krejzek
Hello, please can you help me how to use Flux model in Mlops? Is that possible?
Will H
Hi Mo, it seems like this img2img only works with 1x1 aspect ratios. What would need to be changed for it to work on 512x768?
Patrick Cabral
I resorted to downgrading to Stable Diffusion d006108d75d74b3237ccbb60a9373bf28c2b85d7 to make this work.
Patrick Cabral
Yes. I have those. Also when I am using this work-around, it does load the controlnet model although it's throwing error on the image . https://github.com/Mikubill/sd-webui-controlnet/issues/567 I am using Stable Diffusion a9fed7c364061ae6efb37f797b6b522cb3cf7aa2 I read somewhere that the current version broke the API. Maybe give me your current Stable Diffusion version so I can roll back to that version. Or you can update to the latest stable diffusion so you can reproduce the bug.
Entagma
Hi Patrick, yes. That file works for me. Did you make sure you have the proper settings enabled in the controlnet extension's settings page in webUI? (Max number of models, max cache number, allow control via Script etc.)
Patrick Cabral
Hello Mo, Thanks for the updating the file. Were you able to make it work on your end? The updated file still doesn't load the models for some reason.
Entagma
Thanks for giving me the heads up - I just added an updated scene file with the new proposed workflow. Cheers, Mo
Juan Sloane
thanks a lot. Unfortunately not working for me - not sure if Entagma has an update but will keep looking
Patrick Cabral
They were using this workaround at https://github.com/Mikubill/sd-webui-controlnet/issues/571 I manage to load the controlnet that way, but for some reason it's throwing errors .
Juan Sloane
I was getting weird results, nothing to do with the tutorial. Will look into your post. thanks!
Patrick Cabral
Hello, New member here. I think this doesn't work with the latest Stable Diffusion Controlnet update from a couple of days ago. Here's I think is the new API https://github.com/Mikubill/sd-webui-controlnet/wiki/API#migrating-from-controlnet2img-to-sdapiv12img
