Popular repositories Loading

1. AutoSmoothQuant AutoSmoothQuant Public

   An easy-to-use package for implementing SmoothQuant for LLMs

   Python 69 4

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 8 4

3. smoothquant smoothquant Public

   Forked from mit-han-lab/smoothquant

   [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

   Python 8 1

4. torch-int torch-int Public

   Forked from Guangxuan-Xiao/torch-int

   This repository contains integer operators on GPUs for PyTorch.

   Python 3 2

5. TarsCpp TarsCpp Public

   Forked from TarsCloud/TarsCpp

   C++ language framework rpc source code implementation

   C++

6. TarsGo TarsGo Public

   Forked from TarsCloud/TarsGo

   A high performance microservice framework in golang. A linux foundation project.

   Go