💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Python bindings for the Transformer models implemented in C/C++ using GGML library.

Python bindings for llama.cpp

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

Structured Text Generation

LLM inference in C/C++

LM Studio CLI

Code for the book Deep Learning with PyTorch by Eli Stevens, Luca Antiga, and Thomas Viehmann.

PyTorch tutorials.

An AI search engine inspired by Perplexity

Fast and memory-efficient exact attention

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

Retrieval and Retrieval-augmented LLMs

A modular graph-based Retrieval-Augmented Generation (RAG) system

LLM101n: Let's build a Storyteller

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

This repository contains demos I made with the Transformers library by HuggingFace.

Bootstrap Kubernetes the hard way. No scripts.

Large Language Model Text Generation Inference

End-to-End LLM Guide

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

Morpheus Local Agents

A framework for few-shot evaluation of language models.

FRP Fork