Illustrious-XL SmoothFT

UPDATE: Added SPO version, thanks to qelt for the suggestion!

Smooth Fine-Tune of the Illustrious-XL base model

This is a personal fine-tune of Illustrious-XL - v0.1 | Stable Diffusion XL Checkpoint

It was trained for one epoch on the same dataset I used for Bijutsubu - v1.0

The fine-tune was then re-merged with the original model using the weights:

0.5,0.3,0.3,0.3,0.15,0.15,0.15,0.15,0.15,0.15,1,0,0,0,0.15,0.15,0.15,0.15,0.15,0.15

This was done to retain the characteristics of the original model, while helping fix the block artifact issues I ran into with Illustrious, which are exaggerated by image compression even further:

To illustrate (contrast has been enhanced):

Left: original; Right: SmoothFT

Another example:

The model obviously underwent other changes as a result of the FT, but largely remains true to the original base model.

Thank you to Angel and OnomaAI for this amazing model.

License