Originally posted to HuggingFace by TopdeckingLands

Art of MtG v1

Experimenal model, based on ~5000 arts for cards from Magic: the Gathering game on top of SD1.5 model. Large variety of cards from 2014 to 2022 was used. Logos, guild/clan icons and mana symbols were not part of training set as Fan Content Policy explicitly prohibits their use. Each art was captioned with card name, artist, colors and name of color combination, type line, set name and BLIP description.

You can try it out on Huggingface Space (probably slow) and Google Colab

Usage

mtg art is the main prompt to use, and adding card frame negative prompt is recommended.

Model has understanding of some planes, terms and characters to different degree. Previews below use negative prompt lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, Euler sampler, 20 steps and CFG 7.

Planes

Planes that did not have sets named after them are unknown to model.

Characters

Even main cast of planeswalkers that appear often does not work consistently, even if it's often possible to recognize character - the styles are wildly different between specific original arts.

Species

Model has good understanding of phyrexian and Emrakul(tentacle) type of eldrazi among others

Artists

A total of 200 artists had at least 5 images included, 50 of them had more than 30 each. It's safe to expect every major modern MtG artist style to be represented and reproducible to some degree. Styles are not supposed to be representative of artist's real style and are biased by types and colors of cards illustrated by them.

Color combination names used

• 0-color: colorless
• 1-color: monowhite, monoblue, monoblack, monored, monogreen
• 2-color: guilds of Ravnica
• 3-color: shards of Alara, clans of Tarkir, triomes of Ikoria, families of New Capenna (relevant two)
• 4-color: no special names
• 5-color: WUBRG

Different color combinations have different aesthetic attached. X room for example:

Improvements considered for V2

• Filter out highly off-style Secret Lar card / Variations
• Use scryfall art tags for descriptions in addition to BLIP, dropping use of color combination names
• Add more character-centric data or refine on their art after main training
• Fix BLIP hiccups hiccups hiccups hiccups hiccups hiccups hiccups hiccups

Fine-tuning data was provided by Wizards of the Coast under their Fan Content Policy. Note you can't use this model for commercial purposes, as it's strongly against given policy.