Automatic1111 Stable Diffusion WebUI GIF Extension

The purpose of this script is to accept an animated gif as input, process frames as img2img typically would, and recombine them back into an animated gif. Intended to provide a fun, fast, gif-to-gif workflow that supports new models and methods such as Controlnet and InstructPix2Pix. Drop in a gif and go.

Experimental/WIP similar repos:

• keyframer - Multiple images in same latent space. Good for keyframes.
• frame2frame - Handles video files (and gifs).

Instructions:

• For ControlNet support, make sure to enable "Allow other script to control this extension" in settings.
• img2img batch count represents completed GIFs, not individual images.
• All images in a single batch will be blended together. May help with consistency between frames.
• Drop or select gif in the script's box; a preview should appear if it is a valid animated gif.
• Inpainting works, but currently limited to one mask applied to all frames equally.
  • Ensure the img2img Inpaint tab is selected before pressing a send to.. button.
  • Blended image may take some time to generate.
• Results are displayed in output gallery on right side.
• ControlNet extension handling improved:
  • "Target ControlNet models" dropdown added; specifies which models to replace input image with frames.
  • Allows, for example, a static depth background while animation feeds openpose.

Tips:

• Configure and process the gif in img2img (it'll use the first frame) before running the script. Find a good seed!
• If you add an image into ControlNet image window, it will default to that image for guidance for ALL frames.

Installation:

• Install from the Automatic1111 WebUI extensions list, restart UI or
• Clone this repo into your Automatic1111 WebUI /extensions folder, restart UI

Changelog:

• 4/18/23: Adjusted inpainting functionality to act more predictably with current A1111 release.
• 4/17/23: Pared back rarely-used options to focus on primary functions (made 'old' branch). Improved ControlNet handling.