Tensor library for machine learning

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

nanoGPT style version of Llama 3.1

An implementation of Shazam's song matching algorithm.

A minimal Tensor Processing Unit (TPU) inspired by Google's TPUv1.

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

DataChain 🔗 AI-dataframe to enrich, transform and analyze data from cloud storages for ML training and LLM apps

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Create LLM agents with long-term memory and custom tools 📚🦙

Kickstart your MLOps initiative with a flexible, robust, and productive Python package.

Process manager and website for hosting multiple Streamlit apps

Stateful load balancer custom-tailored for llama.cpp

Production-Grade Container Scheduling and Management

Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.

CUDA related news and material links

An ML Systems Onboarding list

Material for cuda-mode lectures

structured outputs for llms

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

A Portfolio website built with React and ThreeJS

This is a repo with links to everything you'd ever want to learn about data engineering

Get up and running with a new Python project, already set up with industry-standard tools for a fantastic development experience.

PyTorch native quantization and sparsity for training and inference

🧩📘 Solve technical interview problems from Project Euler, Reddit's r/dailyprogrammer, and CodingBat in Visual Studio Code. Built on Fastify.

The Cloud Native Application Proxy

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

Notes on "Programming Massively Parallel Processors" by Hwu, Kirk, and Hajj (4th ed.)