Black Mixture
patreon
Black Mixture's Advanced WAN2.1 (Video-to-Video Workflow with Depth Control)
🕑 Added 2025-04-04 13:00:15 +0000 UTCHey Black Mixture Fam! ๐๐พ Here's our latest ComfyUI workflow featuring advanced Video-to-Video generation with depth map control for unprecedented motion stability and creative control. This workflow builds on our previous WAN2.1 release but takes video generation to the next level.
๐Get more WAN 2.1 workflows here:
https://www.patreon.com/posts/create-amazing-1-124383647
๐ฅ Model Downloads
Required Models & Installation
Place these files in their respective directories:
โ ๏ธ IMPORTANT: Make sure to use the wan2.1_t2v_1.3B model for this workflow.
๐น WAN2.1 Diffusion Models (1.3B version)
๐ https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/diffusion_models
๐ ComfyUI/models/diffusion_models
๐น Text Encoder Model
๐ https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/text_encoders
๐ ComfyUI/models/text_encoders
๐น VAE Model
๐ https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/blob/main/split_files/vae/wan_2.1_vae.safetensors
๐ ComfyUI/models/vae
๐น Wan2.1-1.3b-control-lora-depth (NEW!)
๐ https://huggingface.co/spacepxl/Wan2.1-control-loras/tree/main/1.3b/depth
๐ ComfyUI/models/lora
โจ Features
Transform videos with precise control using depth maps
Apply creative styles while maintaining motion coherence
Preserve spatial relationships and scene structure from original videos
Generate motion-consistent results even with dramatic style changes
Multiple quality settings (Low, Great, Max Quality) โGeneration times on RTX 4090 GPUโคต
Low (~8 minutes)
Great (~15 minutes)
Max (~30 minutes)
Depth-aware motion control options
Video frame interpolation for smoother results
Support for various input video format
๐จ Workflow Sections
Each workflow is color-coded for easy navigation:
๐ฅ STEP 1: LOAD MODELS - Set up required model components
๐จ STEP 2: LOAD VIDEO + PROMPT - Load your source video and add prompts
๐ฆ STEP 3: VIDEO GENERATION SETTINGS - Configure quality, dimensions, and sampling
๐ฉ STEP 4: SAVE VIDEO - Save and export your results
๐ช HELP & INFO - Support resources and requirements
๐ ๏ธ Additional Settings Explained
Quality Settings: Choose between 1-LOW (FAST), 2-GREAT (MID), or 3-MAX (SLOW)
Image Orientation: Select between 1-PORTRAIT or 2-LANDSCAPE
Video Dimensions: Customize width and height (default: 496ร768 for portrait, 768ร432 for landscape)
Upscale Image: Option to enhance resolution
KSampler Settings: Fine-tune generation parameters with included presets
Depth Control: Adjust strength_model parameter (default: 1.00) to control depth influence
โ๏ธ Quick Start
Update ComfyUI to the latest version
Download and place all required models in their respective directories:
Ensure you're using the wan2.1_t2v_1.3B model
Place the Wan2.1-1.3b-control-lora-depth files in the lora folder (NEW!)
Install missing custom nodes nodes
Load your models, video, and prompt
Configure settings and generate!
๐ง PICK YOUR ADD-ONS
The workflow includes optional add-ons you can enable:
Save Depth Map Video - Output the generated depth maps
2x Video Frame Interpolation - Double your frames for smoother playback
Patch Super Resolution KL - Enhance resolution quality
๐ก Important Notes
Ensure all models are placed in correct directories
Update ComfyUI before using these workflows
Check GPU memory requirements
Join our Discord for support and updates
Use short, simple prompts for best results (example from workflow: "A woman walks on a fashion runway wearing a red hoodie and jeans.")
The "depth_anything" model is included in the workflow (should auto download on first run) for depth map generation
You can enable optional Video Frame Interpolation for smoother results
Compatible with both portrait and landscape orientations with preset dimensions
This workflow is new and highly experimental! Quality improvements will be coming soon so check back here or on our Discord for updates.
Created by Nate Dwarika from The Black Mixture Team
๐ HUGE Thanks to all of our amazing Patreon supporters!
Comments
Coby Christiansen
The litegraph, or workspace, can often be disrupted by extensions or plug ins. Do you know if you have any plugins installed?
Black Mixture
Happy to help with this! Does this issue only happen with this workflow or does it happen with other workflows as well? The canvas issue might be a result of the custom nodes not rendering properly in your browser. I'd recommend installing the custom nodes from the .zip file if the github version causes this error. If you need more help, feel free to send a DM here or send a message on the priority-support channel on Discord (let's you send screenshots).
์ต ์ํ
When I load this workflow and scroll left and right on the canvas, the comfyui canvas breaks and doesn't work. Why is this happening?
