This Workflow for ComofyUI is designed to have ALL the FLUX1.Tools combined in one workflow for using it with inpainting-, outpainting- and img2vid-generation on Architectural Imagery. Might be of use to others here too. The Workflow generates images from Depth-Generation (switch between lora/model or customize e.g. to canny), outputs can then be In-/Outpainted before being send to cogvideox at the end of the process.
Some Examples for INPUTS included, switch models in the Model Loader (Section I) to make use of e.g. flux1-CANNY-dev model.
Please be aware that this workflow demands high ressources in terms of VRAM (as shown in the video). I'm looking forward to make use of less hardware demanding models asap.
_______________________________
Ressources:
MODELS used:
checkpoints
flux1-dev.safetensors
flux1-depth-dev.safetensors
flux1-fill-dev.safetensors
lora
flux1-depth-dev-lora.safetensors
CogVideoX
CogVideoX-5b-1.5-I2V
clip
t5xxl_fp16.safetensors
clip_l.safetensors
vae
ae.safetensors
CUSTOM NODES used:
GitHub - ltdrdata/ComfyUI-Manager
GitHub - rgthree/rgthree-comfy
GitHub - chrisgoringe/cg-image-picker
GitHub - kijai/ComfyUI-KJNodes
GitHub - kijai/ComfyUI-CogVideoXWrapper
GitHub - yolain/ComfyUI-Easy-Use
_______________________________
Download FLUX etc. from BlackForestLabs
Kijai's CogVideoX1_5i2v video related stuff + KJNodes
rgthree-comfy for more comfort
chrisgoringe's cg-image-picker for preview picking
yolain's easy-use nodes and
theUpsiders Logic nodes for some automatic stuff used.
A complete generation of a 1920x1440px image and a 49f long 1360x768px video without extra In- & Outpainting takes about 530s on a 4090, vram peaks at ~23gb, so yes unfortunately for high ressources only atm. If you are interested in updates, head over to my instagram.
v0.5_241213
- fixed Inpainting, visible seems from masking removed (blurred), the correct output will be shown in the preview/save node now cough
- added easier Setting for IMAGE RESIZE RESOLUTION, default set to 1920 Pixel (proportions remain)0.5
- REDUX STRENGTH now can be easily adjusted from CONFIG
- LORA STRENGTH now can be easily adjusted from CONFIG
- added auto-aspect for video Output, depending on your input it now creates landscape/portrait
- simplified video output, process-nodes moved to COGVIDEOX OUTPUT and now it is a one click enable/disable in rgthree's fast bypasser
- combined INPUTS FOR IN- & OUTPAINTING to safe some space
- added standard SAVE IMAGE nodes (Low Quality/LQ: jpg 72 dpi, High Quality/HQ: png 300 dpi CONTAINING METADATA/WORKFLOW)
Go ahead and upload yours!
Your query returned no results – please try removing some filters or trying a different term.