Skip to content

Extension for improving cache utilization in Silly Tavern

Notifications You must be signed in to change notification settings

Vhallo/SillyTavern-CacheChunker

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Cache Chunker

If you naively trim the oldest messages from context, you'll have to rebuild the cache every message once you hit the context limit. This extension instead trims N messages at a time, so you only have to rebuild the cache every N messages.

Configuration

There are two settings you can configure for this extension:

  • Chunk Size: The number of messages to trim at a time. Default is 10.
  • Max Message History Context: This is the maximum length of the messages part of the context. This should be roughly max context length - character card length. I'd like to automate this in the future.

About

Extension for improving cache utilization in Silly Tavern

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages

  • JavaScript 63.2%
  • HTML 36.8%