Black Mixture
patreon
Black Mixture's Advanced WAN2.1 (Video-to-Video Workflow with Depth Control)
🕑 Added 2025-04-04 13:00:15 +0000 UTCHey Black Mixture Fam! ππΎ Here's our latest ComfyUI workflow featuring advanced Video-to-Video generation with depth map control for unprecedented motion stability and creative control. This workflow builds on our previous WAN2.1 release but takes video generation to the next level.
πGet more WAN 2.1 workflows here:
https://www.patreon.com/posts/create-amazing-1-124383647
π₯ Model Downloads
Required Models & Installation
Place these files in their respective directories:
β οΈ IMPORTANT: Make sure to use the wan2.1_t2v_1.3B model for this workflow.
πΉ WAN2.1 Diffusion Models (1.3B version)
π https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/diffusion_models
π ComfyUI/models/diffusion_models
πΉ Text Encoder Model
π https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/text_encoders
π ComfyUI/models/text_encoders
πΉ VAE Model
π https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/blob/main/split_files/vae/wan_2.1_vae.safetensors
π ComfyUI/models/vae
πΉ Wan2.1-1.3b-control-lora-depth (NEW!)
π https://huggingface.co/spacepxl/Wan2.1-control-loras/tree/main/1.3b/depth
π ComfyUI/models/lora
β¨ Features
Transform videos with precise control using depth maps
Apply creative styles while maintaining motion coherence
Preserve spatial relationships and scene structure from original videos
Generate motion-consistent results even with dramatic style changes
Multiple quality settings (Low, Great, Max Quality) βGeneration times on RTX 4090 GPU‡
Low (~8 minutes)
Great (~15 minutes)
Max (~30 minutes)
Depth-aware motion control options
Video frame interpolation for smoother results
Support for various input video format
π¨ Workflow Sections
Each workflow is color-coded for easy navigation:
π₯ STEP 1: LOAD MODELS - Set up required model components
π¨ STEP 2: LOAD VIDEO + PROMPT - Load your source video and add prompts
π¦ STEP 3: VIDEO GENERATION SETTINGS - Configure quality, dimensions, and sampling
π© STEP 4: SAVE VIDEO - Save and export your results
πͺ HELP & INFO - Support resources and requirements
π οΈ Additional Settings Explained
Quality Settings: Choose between 1-LOW (FAST), 2-GREAT (MID), or 3-MAX (SLOW)
Image Orientation: Select between 1-PORTRAIT or 2-LANDSCAPE
Video Dimensions: Customize width and height (default: 496Γ768 for portrait, 768Γ432 for landscape)
Upscale Image: Option to enhance resolution
KSampler Settings: Fine-tune generation parameters with included presets
Depth Control: Adjust strength_model parameter (default: 1.00) to control depth influence
βοΈ Quick Start
Update ComfyUI to the latest version
Download and place all required models in their respective directories:
Ensure you're using the wan2.1_t2v_1.3B model
Place the Wan2.1-1.3b-control-lora-depth files in the lora folder (NEW!)
Install missing custom nodes nodes
Load your models, video, and prompt
Configure settings and generate!
π§ PICK YOUR ADD-ONS
The workflow includes optional add-ons you can enable:
Save Depth Map Video - Output the generated depth maps
2x Video Frame Interpolation - Double your frames for smoother playback
Patch Super Resolution KL - Enhance resolution quality
π‘ Important Notes
Ensure all models are placed in correct directories
Update ComfyUI before using these workflows
Check GPU memory requirements
Join our Discord for support and updates
Use short, simple prompts for best results (example from workflow: "A woman walks on a fashion runway wearing a red hoodie and jeans.")
The "depth_anything" model is included in the workflow (should auto download on first run) for depth map generation
You can enable optional Video Frame Interpolation for smoother results
Compatible with both portrait and landscape orientations with preset dimensions
This workflow is new and highly experimental! Quality improvements will be coming soon so check back here or on our Discord for updates.
Created by Nate Dwarika from The Black Mixture Team
π HUGE Thanks to all of our amazing Patreon supporters!
Comments
Coby Christiansen
The litegraph, or workspace, can often be disrupted by extensions or plug ins. Do you know if you have any plugins installed?
Black Mixture
Happy to help with this! Does this issue only happen with this workflow or does it happen with other workflows as well? The canvas issue might be a result of the custom nodes not rendering properly in your browser. I'd recommend installing the custom nodes from the .zip file if the github version causes this error. If you need more help, feel free to send a DM here or send a message on the priority-support channel on Discord (let's you send screenshots).
μ΅ μν
When I load this workflow and scroll left and right on the canvas, the comfyui canvas breaks and doesn't work. Why is this happening?
