A library for mechanistic interpretability of GPT-style language models

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

The simplest, fastest repository for training/finetuning medium-sized GPTs.