v2_FLUX_D_model_Q8_clip_Q8

v2_FLUX_D_model_Q8_clip_Q8_IMG_TO_MG

v2_FLUX_D_model_Q8_clip_Q8_LORA.

v2_FLUX_D_model_Q8_clip_Q8_LORA_IMG_TO_MG

Comparison T5xx fp16 to Q8 - almost the same quality

Comparison Q4 to Q8 (Q8 is extremely close fp16) - Q4 slightly dropped quality but still much better than nf4.

Q4

Q8

Q8Q4

Q4 is also a bit slower than nf4 but quality is far better

Speed Q4 vs Q8