Since the movie is an anthology of different stories animated by different studios, I let this LoRa be influenced by a combination of all the syles to hopefully create it's own somewhat unique style while still giving a general nod and homage to this great movie.

Hunyuan Video

This was created using an existing database of just 512x512 images I had on hand using Diffusion Pipe.

example prompt: HeavyMetalstyle animation of a green alien with a long face, skinny features, orange vest, tan shirt, dark green pants is sitting against the control panel of his spaceship. Lots of switches and light panels and a monitor in the background. The alien is looking at the viewer and has his left hand raised.

SDXL

Based on the popular animation styles used in Heavy Metal. Might need to increase weight to 1.2 if using a realistic model. Also helps to use tags like flat art, or 2D flat art. My first attempt at this so be nice.

Flux

Not perfect by any means but it's a good starting point. Hopefully we'll be able to train loras locally with 12gb sooner than later and I can spend more time on it. I tagged the training data in natural language but it seems to respond well to both types of prompts. Normal guidance seems to work fine. The model can get a little horny sometimes with the boobies but so did the movie so it's fitting.