Shared Middle-Layer for Triton Compilation

Development repository for the Triton language and compiler

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

LLM training in simple, raw C/CUDA

A github action to automate a contributors section in readme.

Material for cuda-mode lectures

Materials for learning SGLang

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at…

SGLang is a fast serving framework for large language models and vision language models.

Universal LLM Deployment Engine with ML Compilation

we want to create a repo to illustrate usage of transformers in chinese

Open deep learning compiler stack for cpu, gpu and specialized accelerators

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

An introduction to language design with building a compiler frontend on top of LLVM.

personal chatgpt

UnderstandingDeepLearing中文翻译

Understanding Deep Learning - Simon J.D. Prince

llm-export can export llm model to onnx.

LLM inference in C/C++

Tensor library for machine learning

A 4-hour coding workshop to understand how LLMs are implemented and used

A list of awesome compiler projects and papers for tensor computation and deep learning.

程序语言与编译技术相关资料（持续更新中）

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

FlagGems is an operator library for large language models implemented in Triton Language.

Inference Llama 2 in one file of pure C

LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.

llama3 implementation one matrix multiplication at a time