We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Merge pull request #28 from MDK8888/GPTQ GPTQ
Merge pull request #19 from MDK8888/pyyaml-update minor fixes for pyyaml
Merge pull request #17 from MDK8888/static_kv_cache Added Static KV Caching for all Huggingface Models