Pinned Loading

1. hpcaitech/ColossalAI hpcaitech/ColossalAI Public

   Making large AI models cheaper, faster and more accessible

   Python 38.8k 4.3k

2. Tencent/TurboTransformers Tencent/TurboTransformers Public

   a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

   C++ 1.5k 198

3. Tencent/PatrickStar Tencent/PatrickStar Public

   PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

   Python 747 57

4. xdit-project/xDiT xdit-project/xDiT Public

   xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

   Python 727 56

5. LLMSpeculativeSampling LLMSpeculativeSampling Public

   Fast inference from large lauguage models via speculative decoding

   Python 582 58

6. long-context-attention long-context-attention Public

   USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

   Python 368 24