[SD1.5] ColorSplash - V-prediction Vibrant Anime Mix

v0.1
AzelusLightvale
2 months ago

WARNING: HERE BE DRAGONS!

This model's CLIP is incompatible with Model Toolkit. Do not use Model Toolkit to check/prune this model, for this is impossible without destroying the model itself. See this article for more information.

Also, this model uses zSNR and V-prediction. Download the .yaml config file and place it in the same folder as your models (for A1111/Forge); or use ModelDiscreteSampling node (for ComfyUI)

What is this model?

ColorSplash (previously named ColorStorm in preview images, now remade to work better) is a Stable Diffusion 1.5 merge created to test whether v-prediction can be merged in without losing too much quality. It's a work-in-progress as I try and make it work.

How to use this model?

Prompting:

This model (in my testing) uses booru tags very well, but can rarely use natural language.

Style is hard to influence with this model. With small prompt counts, the model is clean and crisp, but gets more distorted the more words is added. To counter this issue, Hi.res fix is highly recommended

Like most anime checkpoints, this one also has a female bias, but it can be countered.

This model is mainly tested against ComfyUI's prompt parser and reForge's default parser (with .yaml config file).

Character recognition should work well with really popular characters, but not much else. 9th Tail's character training is degraded, but not lost. ConcoctionMix's use of Hololive and AIOMonsterGirl isn't fully lost either, though it's also degraded a bit. Quick note: Suzuran's multiple tails might bleed through.

This model is also surprisingly good at furry content. Not quite sure why though...

Also, "brown-outs" happens when touching merged knowledge (tints the image brown in most cases), so do be careful about that.

Parameters:

(Anything in bold has been tested and working decently fine)

  • Sampler + Scheduler: Almost anything works, but with some browning. Best solution would be Euler beta, DPM++ 2M beta, with secondary recommendations being: Euler a, DPM++ 2M SGM Uniform, DPM Adaptive, UniPC simple, DDIM (with ddim_uniform), DPM++ SDE Beta. Karras schedulers are completely unusable. This is probably the only issue with v-prediction models

  • Steps: 20+

  • CFG: 4-12 (recommended range: 4-6, 7-12 is usable, but artifacted), RescaleCFG recommended

  • CLIP Skip: 1-2

  • Resolution: 3:2 aspect ratio tested, base 768 resolution and below (640, 512) are usable.

  • Hi.res fix: Highly recommended. Tested at 1.5x latent upscale

Merge recipe:

ColorSplash-v0.1

The image is the entirety of the ColorSplash-v0.1 merging recipe in ComfyUI form. Uses comfy-mecha and ComfyUI-DareMerge [not properly]. Metadata included inside image.

It's a simple TIES merge (k=0.9) with:

  • Model A: 9th Tail - main_v0.3

  • Model B: ConcoctionMix-a1 [Vodka]

  • Model C: ConcoctionMix-a2 [Vermouth]

ColorSplash-v0.1.1

V0.1.1 uses exclusively comfy-mecha, since, I don't need to alter CLIP at all.

To those that can't read the image, it's a 2-step merge with 4 models:

  • Model A: ColorSplash - v0.1 (It was initially meant to be a ConcoctionMix experiment)

  • Model B: AIOMonsterGirl - v4 (more cohesive knowledge transfer)

  • Model C: OpenSolera - a6 [Fleur] (same idea)

  • Model D: FluffyRock Unleashed - v1.0 Base (same idea)

Step 1: Train Difference using A-x-A method, where x is model B, C, or D

Step 2: Perform a TIES Sum with Dropout (with k=1), then add it back into model A

ColorSplash-v0.1.2

Read more...

What is [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix?

[SD1.5] ColorSplash - V-prediction Vibrant Anime Mix is a highly specialized Image generation AI Model of type Safetensors / Checkpoint AI Model created by AI community user AzelusLightvale. Derived from the powerful Stable Diffusion (SD 1.5) model, [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix has undergone an extensive fine-tuning process, leveraging the power of a dataset consisting of images generated by other AI models or user-contributed data. This fine-tuning process ensures that [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix is capable of generating images that are highly relevant to the specific use-cases it was designed for, such as anime, base model, experimental.

With a rating of 0 and over 0 ratings, [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix is a popular choice among users for generating high-quality images from text prompts.

Can I download [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix?

Yes! You can download the latest version of [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix from here.

How to use [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix?

To use [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix, download the model checkpoint file and set up an UI for running Stable Diffusion models (for example, AUTOMATIC1111). Then, provide the model with a detailed text prompt to generate an image. Experiment with different prompts and settings to achieve the desired results. If this sounds a bit complicated, check out our initial guide to Stable Diffusion – it might be of help. And if you really want to dive deep into AI image generation and understand how set up AUTOMATIC1111 to use Safetensors / Checkpoint AI Models like [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix, check out our crash course in AI image generation.

Download (1.94 GB) Download available on desktop only
You'll need to use a program like A1111 to run this – learn how in our crash course

Popularity

420 ~10

Info

Base model: SD 1.5

Latest version (v0.1): 2 Files

To download these files, please visit this page from a desktop computer.

About this version: v0.1

No codenames, just actual versioning. This model is still experimental. There's room for improvements right now, but it's still a good starting point.

Uses regular positive and negative prompts. Embeddings untested, but probably won't work. Weighting up to interpretation.

Positive: best quality, masterpiece

Negative: (worst quality:1.4), (low quality:1.4)

This model is made from the following:

Checkpoints:

LoRAs (for CLIP):

CLIP: zer0int's CLIP-ViT-L-14 smooth-GmP variant

VAE (baked in): WD1.4-kl-f8-anime2-bless09

3 Versions

😥 There are no [SD1.5] ColorSplash - V-prediction Vibrant Anime Mix v0.1 prompts yet!

Go ahead and upload yours!

No results

Your query returned no results – please try removing some filters or trying a different term.