You like pytorch? You like micrograd? You love tinygrad! ❤️

🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools

A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer

Erasing concepts from neural representations with provable guarantees

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

Protocol Buffers implementation in C

A high-performance, fully-featured CSV parser and serializer for modern C++.

QLoRA: Efficient Finetuning of Quantized LLMs

kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)

C-based/Cached/Core Computer Vision Library, A Modern Computer Vision Library

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformer…

Tensor library for machine learning

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

LLM papers I'm reading, mostly on inference and model compression

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Stable Diffusion in pure C/C++

Tiny data-over-sound library

LLM inference in C/C++

Port of OpenAI's Whisper model in C/C++