Formerly known as auto-sd-krita.

Extension for AUTOMATIC1111's webUI and SD.Next with Krita Plugin

This update should make the extension a lot more flexible in terms of which version of A1111 or SD.Next you can use! If it doesn't work with your version, open an issue and we'll look into it.

Why use this?

• Optimized workflow (txt2img, img2img, inpaint, upscale) & UI design.
• Only drawing studio plugin that exposes the Script API.

Refer to https://github.com/ClashSAN/sd-webui-extension-records for current working extension & webUI commits and how to switch commits. This is useful when upstream webUI changes break the extension.

Currently stuck on two things with regards to further development:

• Config preset system: https://github.com/Interpause/auto-sd-paint-ext/tree/feat-config-presets
  • Currently having issues figuring out how to implement it without needing to overhaul everything.
• Switch to official API

See Interpause#41 for planned developments.

• Full Installation & Workflow Tutorial Video! (Coming Soon...)
• Installation Guide
• Usage Guide
  • Step by Step Guide to Better Inpainting
• Update Guide
• Features
• TODO
• Contribution Guide

Thanks @rexelbartolome for making these videos:

• Installation: https://youtu.be/eCSIqJ5cmJs
• Rundown of plugin features: https://youtu.be/h-BIC9iuPGc

Q: How does the base_size, max_size system work?

A:

It is an alternative to AUTO's highres fix that works for all modes, not just txt2img.

The selection will be resized such that the shorter dimension is base_size. However, if the aforementioned resize causes the longer dimension to exceed max_size, the shorter dimension will be resized to less than base_size. Setting base_size and max_size higher can be used to generate higher resolution images (along with their issues), essentially disabling the system, though it might make sense for img2img mode.

This is actually smarter than the builtin highres fix + firstphase width/height system. Thank the original plugin writer, @sddebz, for writing this.

Q: Outpainting tab?

A: While the outpainting tab is still WIP, the outpainting scripts (under img2img tab) works perfectly fine! Alternatively, if you want more control over outpainting, you can:

1. Expand the canvas
2. Scribble in the newly added blank area
3. img2img on the blank area + some of the image

Q: Is the model loaded into memory twice?

A: No, it shares the same backend. Both the Krita plugin and webUI can be used concurrently.

Q: How can you commit to updating regularly?

A: It is easy for me.

Q: Will it work with other Krita plugin backends?

A: Unfortunately no, all plugins so far have different APIs. The official API is coming soon though...

See CHANGELOG.md for the full changelog.

Prior versions of auto-sd-paint-ext were incredibly prone to breaking when A1111 or SD.Next updated, due to tapping into internal API calls. This resulted in lots of downtime on the extension, and a version that worked for A1111 would break on SD.Next.

With this update, the extension is far more robust:

• The extension now works for A1111 and SD.Next
• The extension is now forward and backwards compatible, being able to work on older and newer
• Add a parameter warning system when the backend expects a parameter which the plugin does not have (yet)

An example image of the new parameter warning system.

• Add ability to disable base size/max size system; Image generated will be same size as selection.

• Removed "Use selection as mask" option; Using the selection to mask generated images is now default behaviour.
• Added "Add transparency mask" option; Choose to mask generated images by adding transparency mask, or directly flatten/crop image.
• Top paintlayer will now be set as active layer when generation is complete.
• New docker that shows a live preview of image generation (if enabled in WebUI).

• Added "Alt Dock Behaviour" under "SD Plugin Config".
  • Modifies default Krita dock behaviour!
    • Dragging title bar of docker now drags all stacked/tabbed dockers out instead of just one docker.
    • Dragging the tab now drags the specific docker out instead of only re-arranging the tab.
  • Enables floating stacked/tabbed dockers.
  • Enables subdividing dock areas further.
  • See: https://doc.qt.io/qt-6/qmainwindow.html#DockOption-enum
• All generations are added to group layer per batch with generation info.
  • For batches of generations, all but the last image generated is hidden by default.

• @sddebz for writing the original backend API and Krita plugin while keeping the Gradio webUI functionality intact.

MIT for the Krita Plugin backend server & frontend plugin. Code has been nearly completely rewritten compared to original plugin by now.