This Workflow for ComofyUI is designed to have ALL the FLUX1.Tools combined in one workflow for using it with inpainting-, outpainting- and img2vid-generation on Architectural Imagery. Might be of use to others here too. The Workflow generates images from Depth-Generation (switch between lora/model or customize e.g. to canny), outputs can then be In-/Outpainted before being send to cogvideox at the end of the process.

Some Examples for INPUTS included, switch models in the Model Loader (Section I) to make use of e.g. flux1-CANNY-dev model.

Please be aware that this workflow demands high ressources in terms of VRAM (as shown in the video). I'm looking forward to make use of less hardware demanding models asap.

_______________________________
Ressources:

MODELS used:

checkpoints

flux1-dev.safetensors
flux1-depth-dev.safetensors
flux1-fill-dev.safetensors

lora

flux1-depth-dev-lora.safetensors

CogVideoX

CogVideoX-5b-1.5-I2V

clip

t5xxl_fp16.safetensors
clip_l.safetensors

vae

ae.safetensors

CUSTOM NODES used:

GitHub - ltdrdata/ComfyUI-Manager
GitHub - rgthree/rgthree-comfy
GitHub - chrisgoringe/cg-image-picker
GitHub - kijai/ComfyUI-KJNodes
GitHub - kijai/ComfyUI-CogVideoXWrapper
GitHub - yolain/ComfyUI-Easy-Use

_______________________________

Download FLUX etc. from BlackForestLabs

Kijai's CogVideoX1_5i2v video related stuff + KJNodes

rgthree-comfy for more comfort

chrisgoringe's cg-image-picker for preview picking

yolain's easy-use nodes and

theUpsiders Logic nodes for some automatic stuff used.

A complete generation of a 1920x1440px image and a 49f long 1360x768px video without extra In- & Outpainting takes about 530s on a 4090, vram peaks at ~23gb, so yes unfortunately for high ressources only atm. If you are interested in updates, head over to my instagram.

Search AI Models & Addons

very few results