NerdyRodent
patreon
Flux... only smol
🕑 Added 2024-08-18 11:25:58 +0000 UTCLoads more unets have dropped - ideal for those with smol GPUs! There is even a Q2 :)
Can be 50% slower than the standard dev model FP8 weight type, but it's a small price to pay. Wonder how many times I can mention small?
Anyway, here are all the options at the moment:
https://huggingface.co/city96/FLUX.1-dev-gguf/tree/main
You will need the GGUF UNET loader custom load though:
https://github.com/city96/ComfyUI-GGUF
Looks like some may even work with loras too!
Comments
Nerdy Rodent
GGUF is just 1 optional node from https://github.com/city96/ComfyUI-GGUF - simply replace the existing model loading node in any workflow with one to load GGUF instead :)
Theron Govender
Wheres the json workflow for this one
Nerdy Rodent
So many to try now!
Nibmeister
The Q4 K S version is now my go to model for Flux, as it works with all of the LoRAs I've tried. Q8 didn't seem to work with LoRAs.
Nerdy Rodent
The controlnets still aren't really up to SD 1.5 quality yet, but give it a couple of months and all the bits should be there!
Stephen Hilsdon
Fantastic. Any chance you might revisit your Reposer workflows with Flux in mind? Particularly interested in the face + pose + clothes one
Nibmeister
I get a lot of odd warnings loading the Q8 version of Flex Dev GGUF but it loads really fast and achieves 6s/it on my 8GB VRAM 3070TI.
