Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

120+ interactive Python coding interview challenges (algorithms and data structures). Includes Anki flashcards.

You like pytorch? You like micrograd? You love tinygrad! ❤️

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

A simple, performant and scalable Jax LLM!

Type annotations and runtime checking for shape and dtype of JAX/NumPy/PyTorch/etc. arrays. https://docs.kidger.site/jaxtyping/

Multi-Agent Reinforcement Learning with JAX

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind

Universal Tensor Operations in Einstein-Inspired Notation for Python.

Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

Sparse autoencoders

🏛️A research-friendly codebase for fast experimentation of single-agent reinforcement learning in JAX • End-to-End JAX RL

Flask-based package for monitoring utilisation of nVidia GPUs.

ctypes wrappers for HIP, CUDA, and OpenCL