Simple-ish Pony/Illustrious Workflow

v5b
Gladas
7 months ago

This workflow (as of v1.6) works as follows:

"Load Lora" node is not needed. To use a lora, please use the "Select to add Lora" option on the "Positive Prompt" node.

Note: if your prompts seem like they being completely ignored, please make sure to check if the "Mode" on the prompt nodes are set to Populate and not Fixed.

This has been tested on Illustrious and Pony models as mentioned in my "Suggested Resources". YMMV. Try playing with the settings/prompts to find your happy place. Current settings are to my tastes (for Illustrious) and may be aggressive for some models, leading to cooking the image.

I strongly recommend using ComfyUI manager to install any missing custom nodes.

v1.6 changes:

Faster workflow. Takes roughly 3.5 minutes on a 3060.

  • Removed Lying Sigma Sampler node for the more advanced Detail Daemon Sampler node.

  • Also removed the second KSampler. So now it's just the one Ultimate SD Upscale node for the upscale portion of the workflow.

Added the option to use FaceDetailer (AV).

  • I didn't notice a difference between this one and the one from the Impact Pack. If you prefer the Impact Pact one, you can just sub it in.

  • To use FaceDetailer, you will need some sort of face detection model. I use this one.

rgthree-comfy has a nice feature that can set a group to be bypassed in a workflow.

I have the FaceDetailer in its own group.

If you feel like you don't need to use it all the time, you can just toggle the icon that looks like a connector and it will bypass the FaceDetailer. This cuts off around 30 to 40 seconds from the workflow for me.

v1.5 changes:

Took what I liked about v1.4 and v1.3.

  • Dropped ApplyRAUnet and PerturbedAttentionGuidance from the workflow.

  • Added Dynamic Thresholding

  • Layout is similar to v1.3 again.

Settings are based on my tastes, please adjust to your liking!

Full workflow from start to finish averages about 4 to 5 minutes on my 3060.

v1.4 changes:

This version is specifically for use with the CFG++SamplerSelect node. If you do not plan on using the CFG++SamplerSelect node, then v1.3 should still be good to use!

I also added the ApplyRAUnet and PerturbedAttentionGuidance nodes.

Nothing too fancy but has been working great for me. For more info on the new additions (and an old one) please go to:

CFG++SamplerSelect: https://github.com/pamparamm/ComfyUI-ppm

Lying Sigma Sampler: https://github.com/Jonseed/ComfyUI-Detail-Daemon

PerturbedAttentionGuidance: https://github.com/pamparamm/sd-perturbed-attention

ApplyRAUNet: https://github.com/blepping/comfyui_jankhidiffusion

Note: Depending on the checkpoint/model you are using, you may have to make adjustments to the settings (as expected). Some models handle higher numbers in "Lying Sigma Sampler - dishonesty_factor." The author of the node recommends 0.1 for SDXL based models. You can play with higher numbers and see how it turns out for you.

The plus side:

  • More CFG++ samplers.

  • More stable end results (at least in my testing).

The downside:

  • Image Saver does not see the samplers from CFG++SamplerSelect by default. So the field for "sampler_name" will have to be manually entered on the Image Saver node.

  • Full workflow takes longer from start to finish. Roughly 6 minutes on my 3060 RTX.

v1.3 changes:

  • Added Detail-Daemon nodes

  • Added Image Comparer nodes from rgthree's ComfyUI Nodes.

As of 1.3 the workflow works as follows:

  • Initial Image Generation

  • Watermark detection/removal

  • Upscale x1.5

  • Upscale x2.5

  • Color Correction

  • Save Image

Please feel free to adjust the settings to your preferences. At these settings, I typically generate an image from start to finish in about 4.5 minutes on my 3060 RTX.

v1.2 and earlier:

This workflow works as follows:

  • Initial Image Generation

  • Watermark Removal (this requires a watermark detection model that will need to be placed in your ComfyUI/models/ultralytics/bbox folder) - I use this one: https://civitai.com/models/311869/nsfw-watermark-detection-adetailer-nsfwwatermarkssyolov8

  • Upscale 1st pass (current settings are set to 1.5x of the original image)

  • Upscale 2nd pass (current settings are set to roughly 2.5x of the original image)

  • Color Correction

  • Save Image (You will need to specify your output path on the Image Saver node in the "path" field).

"Load Lora" node is not needed. To use a lora, please use the "Select to add Lora" option on the "Positive Prompt" node.

Note: if your prompts seem like they are completely being ignored, please make sure to check if the "Mode" on the prompt nodes are set to Populate and not Fixed.

I strongly recommend using ComfyUI manager to install any missing custom nodes. If you want to download them manually, see the list below.

List of Custom Nodes used:

  • ComfyUI Image Saver

  • Comfyroll Studio

  • Impact Pack

  • Inspire Pack

  • Ultimate SD Upscale

  • comfyui-art-venture

  • WAS Node Suite

  • Comfyui lama remover

  • ComfyMath

This workflow incorporates a slightly modified version of Dynamic Watermark Removal During Render or Image Upload (by Leinad882) found at https://civitai.com/models/265571/dynamic-watermark-removal-during-render-or-image-upload-by-leinad882. Big thanks to them for creating the bounty for the watermark removal workflow and sharing it with the community.

Thanks to @killedmyself for introducing me to the Color Correct node from comfyui-art-venture. This has really been useful in countering the color fade from Ultimate SD Upscale.

I only use the Brightness, Contrast, and Saturation options for that node, but feel free to adjust to your liking.

Disclaimer: Please be aware that sometimes things break when updates are made by comfy or by the custom node creators. (e.g. Ultimate SD Upscale doesn't like using the scheduler input from ComfyUI Image Saver).

Read more...
Download (9.89 KB) Download available on desktop only

Popularity

920 ~10

Info

Base model: Other

Version v5b: 1 File

To download these files, please visit this page from a desktop computer.

About this version: v5b

Updated demo_settings version of the workflow to have the right upscale setting for the 2nd KSampler. It was set to 2 instead of 1 for the upscale factor.

v5b changes:

Dropped ComfyUI-Adaptive-Guidance

  • Did not seem beneficial enough to keep in the workflow

  • To make full use of it, I would have to create a toggle for the normal node and the negative node version at a minimum.

  • I got better results when just using a standard guider node in many cases.

Added a switch from ComfyUI_Comfyroll_CustomNodes that allows the IMG2IMG group to be bypassed.

  • This node just changes the latent source going into the first KSampler.

  • You will still have to have an image placed in the Load Image node AFAIK, but you can try not having one there and see if it works.

Added a switch to allow for either latent upscaling or upscaling image with model below the 1st KSampler.

  • This affects what latent source feeds into the 2nd KSampler.

  • The 2nd KSampler by default is set to 1x Upscale, but you can adjust it to a higher number. I use it as a 2nd pass KSampler.

I've included 3 versions of the workflow with different settings.

  • The one I used to make the sample images will be the demo_settings version.

With everything turned on and USDU set to Half-tile: it takes about 4 minutes from start to finish on my 3060.

75 Versions

😥 There are no Simple-ish Pony/Illustrious Workflow v5b prompts yet!

Go ahead and upload yours!

No results

Your query returned no results – please try removing some filters or trying a different term.