Gothamv
Follow
Lists (1)
Stars
pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
KAN (Kolmogorov–Arnold Networks) in the MLX framework
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable…
A Machine Learning framework from scratch in Pure Mojo 🔥
All the handwritten notes 📝 and source code files 🖥️ used in my YouTube Videos on Machine Learning & Simulation (https://www.youtube.com/channel/UCh0P7KwJhuQ4vrzc3IRuw4Q)
From the Transistor to the Web Browser, a rough outline for a 12 week course
High Quality Resources on GPU Programming/Architecture
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
A library for mechanistic interpretability of GPT-style language models
Materials for EACL2024 tutorial: Transformer-specific Interpretability
Plot the vector graph of attention based text visualisation
nivibilla / build-nanogpt
Forked from karpathy/build-nanogptVideo+code lecture on building nanoGPT from scratch
Video+code lecture on building nanoGPT from scratch
1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition
Cramming the training of a (BERT-type) language model into limited compute.
llama3 implementation one matrix multiplication at a time
Build robust LLM applications with true composability 🔗
Building a quick conversation-based search demo with Lepton AI.
Implementation of a Transformer, but completely in Triton
Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
Attention is all you need implementation
Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, "Self-supervised learning from images with a joint-embedding predictive arch…
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step