AstolfoRF (3EP) / AstolfoVL (2.5EP) / AstolfoXL (2EP)

Probably the first (and the only) individual Full Finetuning with multi-GPU and... as open-source as it can (may not be copyleft).

LoKR works, but no thanks. 我不做人了，早苗！

Discord: "Good luck".

Specification

Base model (3EP): AstolfoVL, version 2.5EP (VPRED) RF
Base model (2.5EP): AstolfoKarMix-XL, version Evo-2EP VPRED
Base model (2EP): AstolfoKarMix-XL, version NIL1.5 v1.2
Base model (1EP): AstolfoMix-XL, version 255c
Tech report: ch06
Training metrics (tensorboard): HF
Dataset (images > latents): danbooru2024, e621_2024
Dataset (tags + captions): meta_lat.json
1 step = 16 images, 4x RTX 3090 24G.
778k steps for 1EP, 8.0 + 4.6 = 12.6M images
Tag + NLP caption with A1111 token trick
Trainer codes: The PR won't be merged
Train parameter: adamW8bit, UNET 1.5e-6, TE 1.2e-5, BS4 (4 GPU) grad accu 4, 71% UNET (Speed + must underfit)
75-100+ days for 1EP. Train 1 EP only. Save per 10k steps.
Train result and loss curve: Tensorboard in HF
Core concept: Unsupervised learning
Expectation: MID (100% no filter no quality tag) ~~or "reality"~~
Actual: Need TIPO

Full docuementation will be published, which is as long as the AstolfoMix series.