Name		Name	Last commit message	Last commit date
parent directory ..
custom_kernels		custom_kernels
exllama_kernels		exllama_kernels
tests		tests
text_generation_server		text_generation_server
.gitignore		.gitignore
Makefile		Makefile
Makefile-awq		Makefile-awq
Makefile-eetq		Makefile-eetq
Makefile-flash-att		Makefile-flash-att
Makefile-flash-att-v2		Makefile-flash-att-v2
Makefile-vllm		Makefile-vllm
README.md		README.md
poetry.lock		poetry.lock
pyproject.toml		pyproject.toml
requirements.txt		requirements.txt

README.md

Text Generation Inference Python gRPC Server

A Python gRPC server for Text Generation Inference

Install

make install

Run

make run-dev