Popular repositories Loading

1. lorax lorax Public archive

   Forked from predibase/lorax

   Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python