Skip to content

Modified Stable Diffusion to include ControlNet and ADetailer for SillyTavern

Notifications You must be signed in to change notification settings

vincedundee/ST-WebUI-Diffusion

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 

Repository files navigation

ST-WebUI-Diffusion

Modified Stable Diffusion Extension to use the SD Forge/A1111 ControlNet and ADetailer API in SillyTavern

Adds ControlNet reference and ADetailer to Silly Tavern's Stable Diffusion A1111/SD Forge Extension. Note: You need SillyTavern setup SD Forge/A1111 with ControlNet and ADetailer already working.

The index.js is a bit .... but if you can be bothered to dive into it, you can find the ControlNet and ADetailer api call near the bottom.

What does this do?

It's an attempt at consistency in imagery using a local install of Automatic 1111 or Stable Diffusion Forge.


To Install

Folder: SillyTavern/public/scripts/extensions/stable-diffusion

  • Backup your stable-diffusion folder
  • Replace your stable-diffusion folder with the one in this repo.
  • Reload your Silly Tavern
  • Activate ControlNet in your settings.

Tested with ST 1.11.5

For better requests

You may still need to prompt properly.

  • Add character specific prompts for your character such as Loras, embeddings and proper promps.
  • Emphasis character features in your character specific prompts. e.g. (brown hair).
  • Use a BadNegative negative embedding.
  • Play around with models. Some are better than others.

Change Log

04-03-2024

  • ADetailer: Added ADetailer options
  • ADetailer: Added multiple models
  • ADetailer: Added confidence slider (weight)

03-03-2024

  • Added Clip Skip option
  • Rebuilt to work with latest ST SD Extension.
  • Added ADetailer.
  • Fixed ControlNet api call as has changed since first build.

Improvements that can be made...

  • Add Option to use FaceID ControlNet. (awaiting fix for SD Forge ControlNet)
  • Would be good to eventually generate expressions from character avatar (SD Forge can now do transparent images using LayerDiff extension).
  • As classify is now in webUI, can probably grab these and force them into the SD prompt.

About

Modified Stable Diffusion to include ControlNet and ADetailer for SillyTavern

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published