Wan2.1-VACE GGUF Workflow for "Free Length" ref2video using For Loop (version 2)

v3.0
Usako_USA
2 months ago

Description:

You can create a video of any length by specifying the "Length" and "Loop Count" according to the original video.

No adjustments are necessary except for the parameters in "Main Configuration" including the above.

For making this, Thanks to @BenjisAIPlayground(https://www.youtube.com/@BenjisAIPlayground) for this great opportunity.

Features (for those who want to modify it):

  1. The first reference image (ref image) is best to use Flux Kontext or similar to match the starting frame and composition of the video. However, Wan2.1 VACE can be used without problems in my opinion because of its good tracking.

  2. The chunk size (specified by Length) makes a difference in the number of Input and Output frames (and also in the first loop and the next and subsequent loops),I have corrected the number of frames in Output to always be "Length-1".

  3. I found since the color of the reference image (ref image) saturates with each loop, so color matching is performed with the most recent reference image just before loop input.

  4. Output video is assumed to be 30 fps; adjust "nth" if you are processing input video at 60 fps, for example.


Release Note:

Improvement:

  1. Background control is now possible.

  2. Processing time could be reduced by selecting either image (ControlNet) or video (Masking).

Bug fix:

  1. now includes sound in the output video.

Read more...
Download (23.3 KB) Download available on desktop only

Popularity

140 ~10

Info

Base model: Wan Video 14B t2v

Latest version (v3.0): 1 File

To download these files, please visit this page from a desktop computer.

About this version: v3.0

Improvements about video output:

  1. Improved output by injecting a CN (DWPose) element when using a video background (using SAM Mask).

  2. when using a reference image background (using ControlNet), CN can be set more precisely; Depth is recommended.

  3. In relation to above, the “Main Configuration” setting can be adjusted, including the case where the background is specified in the prompt (see Note in “How to Select#”).

  4. Added prompt creation support function (using Ollama).

4 Versions

😥 There are no Wan2.1-VACE GGUF Workflow for "Free Length" ref2video using For Loop (version 2) v3.0 prompts yet!

Go ahead and upload yours!

No results

Your query returned no results – please try removing some filters or trying a different term.