LLM training in simple, raw C/CUDA

Instant neural graphics primitives: lightning fast NeRF and more

A massively parallel, optimal functional runtime in Rust

Squeeze-and-Excitation Networks

GPU Accelerated t-SNE for CUDA with Python bindings

Tile primitives for speedy kernels

FlashInfer: Kernel Library for LLM Serving

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing …

UNet diffusion model in pure CUDA

Flash Attention in ~100 lines of CUDA (forward pass only)

Code for KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs

NeRFshop: Interactive Editing of Neural Radiance Fields

Fast CUDA matrix multiplication from scratch

Neighborhood Attention Extension. Bringing attention to a neighborhood near you!

[MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

Code for "Representing Volumetric Videos as Dynamic MLP Maps" CVPR 2023

The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )

CUDA Learning guide

Learning Deformable Tetrahedral Meshes for 3D Reconstruction (NeurIPS 2020)

[ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference

Blazingly fast encoding for neural networks based on permutohedral lattices

LLM training in simple, raw C/CUDA

3D Gaussian Splatting in JAX

Simple and fast low-bit matmul kernels in CUDA

A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!