We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
suppot compress_json
add LLMLingua-2
support customized compression spec
support phi
support mps
support gpt-q
Add retrieval methods, examples, and homepage
release LLMLingua