4.2 - tried not to change or add much

- Added second add noise option (mtb nodes)

- removed apply stg node. either i was using it wrong or it was overridden by other nodes as it changed nothing in the renders for me.

- Changed upscaler Now upscales in 3 - 5 steps and is better (uncoupled CFG for upscale)

- fixed any scaling issues that could happen when the the input image is not divisible by 8.

- moved fps to settings area.

Note - I have tried the tiled new tiled vae, It works, you need to set your temporal size to max, or at least your frame number.

Note 2 - Try setting rescale to 0 (off) i have read details on how perturbed attention works and tested 0 and got better results. Will add more to notes next update.

4.1 bugfixes

- Fixed florence bypass to work with it disabled

- Fixed default upscale setting to work with defaults

- Fixed updscale(added note to explain what its doing and what can be changed)

If you have not updated your python lately and would like to have latest torch and such.

Inside comfy ui main folder is an update folder. This has update comfy and python dependencies. This updates everything.

V4 - useability Update

- Cleaned up the interface to make it simplified

- removed upscale options that should have been copied from base.

- Change how extend works

- Replaced all notes

- changed many small things with the latents for upscale

tips

• Noise (blur) is the main factor in getting movement

• Change seed if you dont like the movement you are getting

• Inserts(addnewframes) / Stretch change how it is rendered, if one does not work try another.

• Scale up gives more movement / Scale down holds to the image ref more.

• Rescale up holds to the image ref more / down allows more movement

• CFG is how much it tries to do your movement, raise this if you get movement but not what you asked for and down if the video is being burnt.

• Number of frames changes settings needed

• 10 steps is enough... 20-30 are ok but can change the video content.

• If upscaling SGM uniform 0.52 denoise works mostly when not complex movements, you can go higher here but it can change things.

How placed at option works ... i think

Latents placed are 8 latents long, meaning

0 is frame 1-8 are replaced with the image latents.

-1 is last frame meaning last 8 frames are replaced by the image latents.

Now... if you have 49 frames, you can use 49/8=6 (rounded down)

This means you can insert the frames into the middle of the video at 8 frame intervals at 6 points.

3 is mid way, 1-2 are frames 9-17 and 18-25 and same for 4-5-6.

V3

-changed interface

-added many examples for all settings

Have fun :)

https://github.com/Lightricks/LTX-Video

Search LTX in manager

Note to users. Previewing the video as its made is possible with an option in the comfy ui settings under VHS settings, Latent preview can be enabled. This shows animated previews as its rendering. Not sure if it slows things down,

Also note this needs to be disabled to use any of my other workflows as this setting makes them crash.

Confirmed working resolutions

512x360 wide and tall

360x360

V2

-added tools group with cropper/removebg groups

-changed prompt to allow pre/app text

-extended the replace functionality

-added upscale group

-added remove/replace after upscale

-added clip extend functionality from upscale or base video gens.

-added many test videos to show settings

-changed default attentions for many things

v1.1

-added video frame extract(request)

-fixed group enablers to properly turn things off

-added apply STG node

-florence prompt now optional can be turned off

-added on/off switch for sampler group to allow image prep.

-added more notes on settings

-included a few test videos with settings to show what they do better.

This is my first delve into LTX

This flow uses Florence and LTX to do single image to video and 2 image frame interpolation.

Few bugs i will fix tomorrow

• All option boxes are set to max one, should be default, right click on the nodes and properties to change this

Tips -

Try turning off stretch in the sampler group, It seems to allow much longer videos.

with this disabled i was able to do 500 frames, 600 caused the video to turn brown...

Features

2 image interpolation

1 image to video

THis works, probably better than sparse controls for animate diff for 2 image interp. But its not perfect, the images need to be close and the same person/scene for the effect to work properly.

Many notes in the flow

Will require the 2 extra ltx nodes from the manager to use this.