TORAX: Tokamak transport simulation in JAX

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Experimental q[X]ora kernel development code

Scalable toolkit for efficient model alignment

BM25S is an ultra-fast lexical search library that implements BM25 using scipy

Implementation for MatMul-free LM.

Code for simulating vLLM

TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frame…

Proof-of-concept of global switching between numpy/jax/pytorch in a library.

Latent Large Language Models

MambaOut: Do We Really Need Mamba for Vision?

Display and control your Android device

GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm

Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"

Collective communications library with various primitives for multi-machine training.

ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization

YaFSDP: Yet another Fully Sharded Data Parallel

Neural Networks: Zero to Hero

This project is a implementation in PyTorch for ZO-AdaMU optimization: Adapting Perturbation with the Momentum and Uncertainty in Zeroth-order Optimization.

Gorilla: An API store for LLMs

LLM Analytics

Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models l…

CUDA accelerated rasterization of gaussian splatting

Zero-effort CLI interfaces & config objects, from types

🐟 Python profile viewer

GPT-2 (124M) quality in 5B tokens

Python logging made (stupidly) simple

Evaluate your LLM's response with Prometheus and GPT4 💯