Seamless operability between C++11 and Python

CUDA Templates for Linear Algebra Subroutines

Step-by-step optimization of CUDA SGEMM

combate-mortal-paradigmas2-2024-fernandezja created by GitHub Classroom

LLM101n: Let's build a Storyteller

Video+code lecture on building nanoGPT from scratch

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

A minimal GPU design in Verilog to learn how GPUs work from the ground up

My favorite C programming practices.

Implementation for MatMul-free LM.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Inference Llama 2 in one file of pure C

LLM training in simple, raw C/CUDA

You like pytorch? You like micrograd? You love tinygrad! ❤️

Notebooks of Datacamp projects