The Multilayer Perceptron Language Model

The Autograd Engine that implements backpropagation

TORAX: Tokamak transport simulation in JAX

An academic project page template powered by React + UIKit, w/ markdown and KaTeX support

LLM101n: Let's build a Storyteller

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)

scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorch

Code for "Making Translators Privacy-aware on the User's Side" (TMLR 2024)

Video+code lecture on building nanoGPT from scratch

Official repository of the xLSTM.

Learning Optimal Policies Through Contact in Differentiable Simulation

Really Fast End-to-End Jax RL Implementations

Control algorithm demonstration project in Rust

An experimental implementation of autograd in Rust

A pedagogical implementation of Autograd

Taylor-mode automatic differentiation for higher-order derivatives

AutoBound automatically computes upper and lower bounds on functions.

Augmented environments with RL

DiscoGrad - automatically differentiate across conditional branches in C++ programs

Bind any function written in another language to JAX with support for JVP/VJP/batching/jit compilation

The hub for EleutherAI's work on interpretability and learning dynamics