FramePack πŸ’Ž img2vid / txt2vid with LoRa Workflow

v1.0
K3NK
4 months ago

FramePack-K3NK-1.2.1.png

v1.2.1

  • added GIMMVIF interpolation

  • added wildcard process node

Added v1.2

  • cleaned prompt inputs and model loaders,

  • added CLIP VISION for helping image details in positive prompt (download)

  • added vram purge management nodes,

  • also made external common inputs for length and latent_window_size

Used kijai's workflow, customized and added

  • upscaler with model and rescaler

  • interpolation with sharpening

  • switch from samplers (default or F1)

  • switch for mode (i2v or t2v)

  • remove 5 frames (from the start for the non pingpong VHS, and from the start and from the end in the pingponged VSH) this is default at 40 frames for t2v

  • Reactor nodes for face swap/refine but those will slow down subsequent generations due to some kind of bug, feel free to delete reactor nodes if you feel like it...

Text to video mode with F1 Sampler:

Hover the FramePack Text Encode (Timestamped) (prompt for F1) for seeing more info about the timestamped patterns for prompts:

* Please let me know if im missing any other custom nodes links so i can add them
Also, theres a bug with current wrappers, if you incrase CFG avobe 1 (default) inference time will by x2 slower.. the only way to fix the workflow, even restarting comfy, is to add a fresh sampler and move the connections.. sad but it is what it is..

Nodes:

https://github.com/kijai/ComfyUI-FramePackWrapper

F1 Sampler still not merged, you can download the two files and replace in ComfyUI\custom_nodes\ComfyUI-FramePackWrapper

https://github.com/kijai/ComfyUI-FramePackWrapper/pull/14/files

GIMMVF:

[https://github.com/kijai/ComfyUI-GIMM-VFI] (model with self download)

Model links:

https://huggingface.co/Kijai/HunyuanVideo_comfy/blob/main/FramePackI2V_HY_fp8_e4m3fn.safetensors

https://huggingface.co/Kijai/HunyuanVideo_comfy/blob/main/FramePackI2V_HY_bf16.safetensors

sigclip:

https://huggingface.co/Comfy-Org/sigclip_vision_384/tree/main

text encoder and VAE:

https://huggingface.co/Comfy-Org/HunyuanVideo_repackaged/tree/main/split_files

----

Read more...
Download (17.4 KB) Download available on desktop only

Popularity

570 ~10

Info

Base model: Hunyuan Video

Latest version (v1.0): 1 File

To download these files, please visit this page from a desktop computer.

3 Versions

πŸ˜₯ There are no FramePack πŸ’Ž img2vid / txt2vid with LoRa Workflow v1.0 prompts yet!

Go ahead and upload yours!

No results

Your query returned no results – please try removing some filters or trying a different term.