Furkan Gözükara
patreon
FLUX Local & Cloud Tutorial With SwarmUI - FLUX: The Pioneering Open Source txt2img Model Outperforming Midjourney & Others - FLUX: The Anticipated SD3
🕑 Added 2024-08-04 20:24:50 +0000 UTC🔗 Comprehensive Tutorial Video Link ▶️ https://youtu.be/bupRePUOA18
FLUX represents a groundbreaking achievement as the first open source txt2img model to genuinely surpass and generate superior quality images with enhanced prompt adherence compared to #Midjourney, Adobe Firefly, Leonardo Ai, Playground Ai, Stable Diffusion, SDXL, SD3, and Dall E3. #FLUX, developed by Black Forest Labs, boasts a team primarily consisting of the original #StableDiffusion creators, and its quality is truly awe-inspiring. This statement is not an exaggeration, as you'll discover upon watching the tutorial. This guide will demonstrate how to effortlessly download and utilize FLUX models on your personal computer and cloud services such as Massed Compute, RunPod, and a complimentary Kaggle account.
🔗 FLUX Guidelines Post (publicly accessible, no login required) ⤵️
▶️ https://www.patreon.com/posts/106135985
🔗 FLUX Models One-Click Robust Automatic Downloader Scripts ⤵️
▶️ https://www.patreon.com/posts/109289967
🔗 Primary Windows SwarmUI Tutorial (View to Learn Usage) ⤵️
▶️ https://youtu.be/HKX8_F1Er_w
🔗 Cloud SwarmUI Tutorial (Massed Compute - RunPod - Kaggle) ⤵️
▶️ https://youtu.be/XFUZof6Skkw
🔗 SECourses Discord Channel for Comprehensive Support ⤵️
▶️ https://discord.com/servers/software-engineering-courses-secourses-772774097734074388
🔗 SECourses Reddit ⤵️
▶️ https://www.reddit.com/r/SECourses/
🔗 SECourses GitHub ⤵️
▶️ https://github.com/FurkanGozukara/Stable-Diffusion
🔗 FLUX 1 Official Blog Post Announcement ⤵️
▶️ https://blackforestlabs.ai/announcing-black-forest-labs/
Video Segments
0:00 Introduction to the truly state-of-the-art txt2img model FLUX, which is Open Source
5:01 Our approach to installing the FLUX model into SwarmUI and utilizing it
5:33 The correct method for manually downloading FLUX models
5:54 How to automatically download FP16 and optimized FP8 FLUX models with a single click
6:45 Determining the best precision and type of FLUX models for your needs and understanding the differences
7:56 The correct folder for placing FLUX models
8:07 Updating SwarmUI to the latest version for FLUX support
8:58 Utilizing FLUX models after SwarmUI initiation
9:44 Implementing CFG scale for the FLUX model
10:23 Monitoring real-time server activities in the debug logs
10:49 Turbo model image generation speed on an RTX 3090 Ti GPU
10:59 Potential blurriness in some turbo model-generated images
11:30 Generating images with the development model
11:53 Using the FLUX model in FP16 instead of the default FP8 precision on SwarmUI
12:31 Differences between development and turbo models of FLUX
13:05 Creating native 1536x1536 images and evaluating FLUX's high-resolution capabilities and VRAM usage
13:41 Image generation speed for 1536x1536 resolution FLUX images on an RTX 3090 Ti GPU with SwarmUI
13:56 Verifying shared VRAM usage - a factor that significantly reduces generation speed
14:35 Employing SwarmUI and FLUX on cloud services - no personal computer or GPU required
14:48 Utilizing pre-installed SwarmUI on Massed Compute's 48 GB GPU for 31 cents per hour with FLUX dev FP16 model
16:05 Downloading FLUX models on a Massed Compute instance
17:15 FLUX models download speed on Massed Compute
18:19 Time required to download all top-tier FP16 FLUX and T5 models on Massed Compute
18:52 Updating and launching SwarmUI on Massed Compute with a single click
19:33 Accessing Massed Compute's SwarmUI on your PC's browser via ngrok - also usable on mobile devices
21:08 Comparing Midjourney-generated image with open source FLUX using identical prompts
22:02 Configuring DType to FP16 for enhanced image quality on Massed Compute with FLUX
22:12 Comparing FLUX-generated image with Midjourney-generated image using the same prompt
23:00 Installing SwarmUI and downloading FLUX models on RunPod for usage
25:01 Comparing step speed and VRAM usage of Turbo model vs Dev model of FLUX
26:04 Downloading FLUX models on RunPod post-SwarmUI installation
26:55 Initiating SwarmUI after pod restart or power cycle
27:42 Resolving visibility issues with SwarmUI's CFG scale panel
27:54 Comparing FLUX quality with top-tier Stable Diffusion XL (SDXL) models using popular CivitAI images
29:20 FLUX image generation speed on L40S GPU - FP16 precision
29:43 Comparing FLUX-generated image with popular CivitAI SDXL image
30:05 Assessing the impact of increased step count on image quality
30:33 Generating higher resolution 1536x1536 pixel images
30:45 Installing nvitop and monitoring VRAM usage for 1536px resolution and FP16 DType
31:25 Evaluating speed reduction when increasing image resolution from 1024px to 1536px
31:42 Utilizing SwarmUI and FLUX models on a free Kaggle account, similar to local PC usage
32:29 Joining the SECourses discord channel for assistance and AI discussions
FLUX.1 [dev] is a 12 billion parameter rectified flow transformer capable of generating images from textual descriptions.
Key Features
State-of-the-art output quality, second only to our cutting-edge model FLUX.1 [pro].
Competitive prompt adherence, matching the performance of proprietary alternatives.
Trained using guidance distillation, enhancing FLUX.1 [dev]'s efficiency.
Open weights to foster new scientific research and empower artists to develop innovative workflows.
FLUX.1 comprises a suite of text-to-image models that establish a new benchmark in image detail, prompt adherence, style diversity, and scene complexity for text-to-image synthesis.
To balance accessibility and model capabilities, FLUX.1 is available in three variants: FLUX.1 [pro], FLUX.1 [dev], and FLUX.1 [schnell]:
FLUX.1 [pro]: The pinnacle of FLUX.1, offering state-of-the-art performance in image generation with superior prompt adherence, visual quality, image detail, and output diversity.
FLUX.1 [dev]: An open-weight, guidance-distilled model for non-commercial applications. Directly derived from FLUX.1 [pro], FLUX.1 [dev] achieves similar quality and prompt adherence capabilities while being more efficient than a standard model of equivalent size. FLUX.1 [dev] weights are accessible on HuggingFace.
FLUX.1 [schnell]: Our fastest model, optimized for local development and personal use. FLUX.1 [schnell] is openly available under an Apache2.0 license. Like FLUX.1 [dev], weights are available on Hugging Face, and inference code can be found on GitHub and in HuggingFace's Diffusers.
Transformer-powered Flow Models at Scale
All public FLUX.1 models are based on a hybrid architecture of multimodal and parallel diffusion transformer blocks, scaled to 12B parameters. FLUX 1 surpasses previous state-of-the-art diffusion models by leveraging flow matching, a versatile and conceptually straightforward method for training generative models, which encompasses diffusion as a special case.
Additionally, FLUX 1 enhances model performance and improves hardware efficiency by incorporating rotary positional embeddings and parallel attention layers.
A New Benchmark for Image Synthesis
FLUX.1 establishes a new standard in image synthesis. FLUX.1 [pro] and [dev] outperform popular models such as Midjourney v6.0, DALL·E 3 (HD), and SD3-Ultra in various aspects: Visual Quality, Prompt Adherence, Size/Aspect Variability, Typography, and Output Diversity.
FLUX.1 [schnell] is the most advanced few-step model to date, surpassing not only its in-class competitors but also robust non-distilled models like Midjourney v6.0 and DALL·E 3 (HD).
FLUX models are specifically fine-tuned to preserve the entire output diversity from pretraining. Compared to the current state-of-the-art, they offer significantly enhanced possibilities.
Comments
Furkan Gözükara
i think i replied you from discord and you fixed right? now accurate folder is here : \SwarmUI\Models\diffusion_models
Proulxmila
When I try to generate with SwarmUI on Massed Compute using FLUX models, I'm getting "All available backends failed to load the model." error at the top of SwarmUI
Furkan Gözükara
I just tested it works here config : https://pasteboard.co/IgPbdoWAiS2d.png
Furkan Gözükara
i plan to do. also let me try and i will report to the developer
Mike
I used your Massed Compute script and it ran no problems. However the inpainting feature in swarm does not work - no changes to the image appear. I tried several comfyUI workflows on youtube, and after working through the errors, I got the same result - no changes to the original image. It would be nice if you could publish a workflow for flux inpainting
Furkan Gözükara
True you need to run it before starting. Please delete already downloaded one. I will make it force overwrite
PTMarks
Working now. Just a note, for the FP16 xxl encoder download, the script gives an error if the file already exists. I think for the other models, your script correctly ends if it sees the model file is already there.
Furkan Gözükara
good catch i just updated zip file please redownload :D also hopefully i am gonna add turbo + dev model merge which works with low steps higher quality
PTMarks
It looks like black-forest-labs just renamed ae.sft to ae.safetensors, (as well as their models to .safetensors) so your model download script throws an error and does not complete.
Furkan Gözükara
it will be at 1 up folder of SwarmUI. so there will be bat and SwarmUI folder. shown in tutorial video
Furkan Gözükara
yep as you said lamarsha thanks for reply
lamarsha
move the bat file up one folder so it's in the same folder as the SwarmUI folder, not in the SwarmUI folder...
sadelcri
hi bro i got this issue Error: SwarmUI folder not found. even though I'm inside the swarmUI Folder with the bat file
