Efficiently computes derivatives of NumPy code.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Inference Llama 2 in one file of pure C

LLM training in simple, raw C/CUDA

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

Minimalistic large language model 3D-parallelism training

Instant voice cloning by MIT and MyShell.

You like pytorch? You like micrograd? You love tinygrad! ❤️

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

DLRover: An Automatic Distributed Deep Learning System

Tensor library for machine learning

System for AI Education Resource.

GLM (General Language Model)

GPT Meet Zotero.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Inference code for Llama models

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Chinese version of GPT2 training code, using BERT tokenizer.

A latent text-to-image diffusion model

Use ChatGPT to summarize the arXiv papers. 全流程加速科研，利用chatgpt进行论文全文总结+专业翻译+润色+审稿+审稿回复

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Ongoing research training transformer models at scale

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo