This Workflow for ComofyUI is designed to have ALL the FLUX1.Tools combined in one workflow for using it with inpainting-, outpainting- and img2vid-generation on Architectural Imagery. Might be of use to others here too. The Workflow generates images from Depth-Generation (switch between lora/model or customize e.g. to canny), outputs can then be In-/Outpainted before being send to cogvideox at the end of the process.
Some Examples for INPUTS included, switch models in the Model Loader (Section I) to make use of e.g. flux1-CANNY-dev model.
Please be aware that this workflow demands high ressources in terms of VRAM (as shown in the video). I'm looking forward to make use of less hardware demanding models asap.
_______________________________
Ressources:
MODELS used:
checkpoints
flux1-dev.safetensors
flux1-depth-dev.safetensors
flux1-fill-dev.safetensors
lora
flux1-depth-dev-lora.safetensors
CogVideoX
CogVideoX-5b-1.5-I2V
clip
t5xxl_fp16.safetensors
clip_l.safetensors
vae
ae.safetensors
CUSTOM NODES used:
GitHub - ltdrdata/ComfyUI-Manager
GitHub - rgthree/rgthree-comfy
GitHub - chrisgoringe/cg-image-picker
GitHub - kijai/ComfyUI-KJNodes
GitHub - kijai/ComfyUI-CogVideoXWrapper
GitHub - yolain/ComfyUI-Easy-Use
_______________________________
Download FLUX etc. from BlackForestLabs
Kijai's CogVideoX1_5i2v video related stuff + KJNodes
rgthree-comfy for more comfort
chrisgoringe's cg-image-picker for preview picking
yolain's easy-use nodes and
theUpsiders Logic nodes for some automatic stuff used.
A complete generation of a 1920x1440px image and a 49f long 1360x768px video without extra In- & Outpainting takes about 530s on a 4090, vram peaks at ~23gb, so yes unfortunately for high ressources only atm. If you are interested in updates, head over to my instagram.
v0.60_250326
- compatibility update for latest ComfyUI (0.3.27, frontend 1.14.5)
- new example inputs for Canny/Depth generation, .exr for testing/editing inputs
- added new SEGMENTANTION INPUT with example file
- added MASK SELECTION switch for inpainting (from segmentation input)
- removed alternative prompt input for mode 0 & 1
- removed mtb-nodes due to conflicting with GUI (note+ node caused freezing)
- removed cg-image-picker (deprecated), replaced with cg-image-filter (NEW STAGE1 PREVIEW SELECTION)
Go ahead and upload yours!
Your query returned no results β please try removing some filters or trying a different term.