Container runtimes on macOS (and Linux) with minimal setup

OpenRecall is a fully open-source, privacy-first alternative to proprietary solutions like Microsoft's Windows Recall. With OpenRecall, you can easily access your digital history, enhancing your me…

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in th…

LLM vulnerability scanner

A high performance implementation of Reciprocal Agglomerative Clustering in C++

Tools for merging pretrained large language models.

Postgres/pgvector Python Client

Open-source vector similarity search for Postgres

Mamba SSM architecture

RETVec is an efficient, multilingual, and adversarially-robust text vectorizer.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

A domain-specific probabilistic programming language for modeling and inference with language models

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

A high-throughput and memory-efficient inference and serving engine for LLMs

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

Fast implementation of Venn-ABERS probabilistic predictors

A Bulletproof Way to Generate Structured JSON from Language Models

Large Language Model Text Generation Inference

Tune any FALCON in 4-bit

Let ChatGPT teach your own chatbot in hours with a single GPU!

Toolkit for creating, sharing and using natural language prompts.

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

Awesome-LLM: a curated list of Large Language Model

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

A guidance language for controlling large language models.

Instruction Tuning with GPT-4

Instruct-tune LLaMA on consumer hardware

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

A simple, performant and scalable Jax LLM!