Highlights
Lists (1)
Sort Name ascending (A-Z)
Stars
Language
Sort by: Recently starred
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Python bindings for the Transformer models implemented in C/C++ using GGML library.
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
Code for the book Deep Learning with PyTorch by Eli Stevens, Luca Antiga, and Thomas Viehmann.
An AI search engine inspired by Perplexity
Fast and memory-efficient exact attention
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
Retrieval and Retrieval-augmented LLMs
A modular graph-based Retrieval-Augmented Generation (RAG) system
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…
This repository contains demos I made with the Transformers library by HuggingFace.
Bootstrap Kubernetes the hard way. No scripts.
Large Language Model Text Generation Inference
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
A framework for few-shot evaluation of language models.