FACE to VIDEO simple workflow WAN2.1 | GGUF | PuLID | UPSCALE | TeaCache

v2.0
UmeAiRT
5 months ago

You can read my guide to using this workflow: link

The easiest way to install all the files needed for workflow use is to use one of my installation scripts. (FLUX model files not included)
To only install the missing nodes, I created another script.

Today's workflow is a little more complex than usual. It extracts facial features to create a new image, then a video from that image.

To do this, the first image is created with FLUX and PuLID, then the video is created with WAN2.1.

Resources you need:

For first frame generation : (FLUX + PuLID)

Files :

Recommendation :
24 gb Vram: Q8_0 + T5_Q8 or FP8
16 gb Vram: Q5_K_S + T5_Q5_K_M or T5_Q3_K_L
<12 gb Vram: Q4_K_S + T5_Q3_K_L

GGUF_Model
city96/FLUX.1-dev-gguf at main (huggingface.co)
"flux1-dev-Q8_0.gguf" in ComfyUI\models\unet

GGUF_clip
city96/t5-v1_1-xxl-encoder-gguf at main (huggingface.co)
"t5-v1_1-xxl-encoder-Q8_0.gguf" in \ComfyUI\models\clip

Better flux text encoder
ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors · zer0int/CLIP-GmP-ViT-L-14 at main (huggingface.co)
"ViT-L-14-GmP-ft-TE-only-HF-format.safetensors" in \ComfyUI\models\clip

VAE
black-forest-labs/FLUX.1-dev at main (huggingface.co)
"ae" in \ComfyUI\models\vae

PuLID
pulid_flux_v0.9.0.safetensors · camenduru/PuLID at main
"pulid_flux_v0.9.0" in \ComfyUI\models\pulid

PuLID need your python to have Insightface :

Automatic : use my missing node script : link

Manual :

Check your python version :

for windows portable version : (the path depends on where you unzipped ComfyUI)

Download Insightface whl which corresponds here : Assets/Insightface at main · Gourieff/Assets
(Here my local python is on 310 and mobile version in 312)

Then install all prerequisites and insightface :
python.exe -m pip install --use-pep517 facexlib
python.exe -m pip install git+https://github.com/rodjjo/filterpy.git
python.exe -m pip install onnxruntime==1.19.2 onnxruntime-gpu==1.15.1 insightface-0.7.3-cp310-cp310-win_amd64.whl

For video generation : (WAN2.1)

Files :

Recommendation :
24 gb Vram: Q8_0
16 gb Vram: Q5_K_S
<12 gb Vram: Q4_K_S

I2V Quant Model: city96/Wan2.1-I2V-14B-480P-gguf at main
In models/diffusion_models

CLIP
split_files/text_encoders/umt5_xxl_fp8_e4m3fn_scaled.safetensors · Comfy-Org/Wan_2.1_ComfyUI_repackaged at main
in models/clip

CLIP-VISION
split_files/clip_vision/clip_vision_h.safetensors · Comfy-Org/Wan_2.1_ComfyUI_repackaged at main
in models/clip_vision

VAE
split_files/vae/wan_2.1_vae.safetensors · Comfy-Org/Wan_2.1_ComfyUI_repackaged at main
in models/vae

UPSCALE MODEL
4x_foolhardy_Remacri.pth · utnah/LDSR at main
in models/upscale_models

Custom Nodes :

Read more...
Download (12.4 KB) Download available on desktop only

Popularity

290 ~10

Info

Base model: Wan Video

Version v2.0: 1 File

To download these files, please visit this page from a desktop computer.

About this version: v2.0

What's new? :

  • New interface,

  • New upscaler,

  • New model optimisation,

  • New LoRA loader.

5 Versions

😥 There are no FACE to VIDEO simple workflow WAN2.1 | GGUF | PuLID | UPSCALE | TeaCache v2.0 prompts yet!

Go ahead and upload yours!

No results

Your query returned no results – please try removing some filters or trying a different term.