New version 3 is trained from the pre-eminent Protogen3.4. I found that training from the photorealistic model gave results closer to what I wanted than the anime model. This model is fantastic for discovering your characters, and it was fine-tuned to learn the D&D races that aren't in stock SD. Works best with 768x512 and other resolutions larger than 512x512
Try a prompt like:
Positive: modelshoot style digital illustration medium shot of an [older woman] elf wearing a long patterned (kilt) and [breastplate], holding a partisan spear and a shield, wearing an (embroidered) traveling quilted cloak, with white hair up in a bun, art by tony sart, wlop and rossdraws and Magali Villeneuve, sharp focus, intricate background of a countryside, hills, farmland, farm building, trees, trending on artstation, trending on cgsociety, rustic, fine art, vivid colors, detailed face and eyes [Brenda Fricker | Katie McGrath | Saoirse Ronan], [flowers and lavender and herbs in belt], [cape], stars, galaxies, nebula, runic symbols, wooden earrings, [samurai], purple gravity energy aura
Negative: glasses, old, animals, watermark, sexy, thin, (blank background), [hands], (anime), photorealistic
Which I used to find an important NPC for my campaign!
Species in new version: aarakocra, aasimar, air_genasi, centaur, dragonborn, drow, dwarf, earth_genasi, elf, firbolg, fire_genasi, gith, gnome, goblin, goliath, halfling, human, illithid, kenku, kobold, lizardfolk, minotaur, orc, tabaxi, thrikreen, tiefling, tortle, warforged, water_genasi Classes in new version: Artificer, Bard, Barbarian, Cleric, Fighter, Druid, Monk, Paladin, Rogue, Ranger, Sorcerer, Warlock, Wizard, Noble, Townsperson
Originally posted to HuggingFace by 0xJustin
Dataset used to train: https://huggingface.co/datasets/0xJustin/Dungeons-and-Diffusion
Good prompts to try things out:
[natural colors], full body tiefling (knight), [watercolor digital 2D painting], (strong shading), hard shadows, blurry, elegant, wearing robes, style of (saga comic) Lois van Baarle and charlie bowater and Sui Ishida, messy, disheveled, thick brushwork, detailed face and eyes, concept art
portrait (painting) of tabaxi, de Rivia closeup, suit, collar, formal attire, D&D, fantasy, intricate, elegant, highly detailed, artstation, concept art, matte, sharp focus, (brush strokes), (oil on canvas), hearthstone, art by Titian and Greg Rutkowski and Rembrandt van Rijn and Alphonse Mucha (inspired by Reddit post)
Dungeons and Diffusion v3 is a highly specialized Image generation AI Model of type Safetensors / Checkpoint AI Model created by AI community user FaelonAssere. Derived from the powerful Stable Diffusion (SD 1.5) model, Dungeons and Diffusion v3 has undergone an extensive fine-tuning process, leveraging the power of a dataset consisting of images generated by other AI models or user-contributed data. This fine-tuning process ensures that Dungeons and Diffusion v3 is capable of generating images that are highly relevant to the specific use-cases it was designed for, such as character, 0xjustin, dungeons & dragons.
With a rating of 4.11 and over 9 ratings, Dungeons and Diffusion v3 is a popular choice among users for generating high-quality images from text prompts.
Yes! You can download the latest version of Dungeons and Diffusion v3 from here.
To use Dungeons and Diffusion v3, download the model checkpoint file and set up an UI for running Stable Diffusion models (for example, AUTOMATIC1111). Then, provide the model with a detailed text prompt to generate an image. Experiment with different prompts and settings to achieve the desired results. If this sounds a bit complicated, check out our initial guide to Stable Diffusion – it might be of help. And if you really want to dive deep into AI image generation and understand how set up AUTOMATIC1111 to use Safetensors / Checkpoint AI Models like Dungeons and Diffusion v3, check out our crash course in AI image generation.
Trained from Protogen