A high-throughput and memory-efficient inference and serving engine for LLMs

Outline Server, developed by Jigsaw. The Outline Server is a proxy server that runs a Shadowsocks instance and provides a REST API for access key management.

[CVPR 2023] Towards Any Structural Pruning; LLMs / SAM / Diffusion / Transformers / YOLOv8 / CNNs

Efficient RPCs for datacenter networks

AIFM: High-Performance, Application-Integrated Far Memory

Next-generation datacenter OS built on kernel bypass to speed up unmodified code while improving platform density and security

A web framework for building multi-user virtual reality experiences.

[ICLR 2018] Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training

Data Plane Development Kit

Data Plane Development Kit

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

Ongoing research training transformer models at scale

PyTorch extensions for high performance and large scale training.

RedLeaf Operating System

This is a code repository for pytorch c++ (or libtorch) tutorial.

Example of tch-rs on M1

Rust bindings for the C++ api of PyTorch.

Switch ML Application

Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

Stanford CS 110L Spring 2020 assignment starter code

OCaml bindings for PyTorch

Minimalist ML framework for Rust

Linux Kernel Programming 2E - published by Packt

RDMA exmaple

Microsoft Collective Communication Library

RDMA core userspace libraries and daemons