深度学习经典、新论文逐段精读

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Minimalistic large language model 3D-parallelism training

Distributed Training Over-The-Internet

PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for evaluation of training and inference platforms.

This repository is established to store personal notes and annotated papers during daily research.

🚀 AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Vi…

NS3 implementation of Homa Transport Protocol

Helios Traces from SenseTime

A NS-3 implementation of Poseidon congestion control algorithm (NSDI 2023).

Generate conventional git commit messages with AI in 1 second 🤯🔫

LLM training in simple, raw C/CUDA

A tutorial on RDMA based programming using code examples

NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference

sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data

Deep Learning Energy Measurement and Optimization

ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale

⏰ Collaboratively track deadlines of conferences recommended by CCF (Website, Python Cli, Wechat Applet) / If you find it useful, please star this project, thanks~

The full minitorch student suite.

AI education materials for Chinese students, teachers and IT professionals.

System for AI Education Resource.

Emulator for rapid prototyping of Software Defined Networks

P4_16 reference compiler