Community interface for generative AI

Interact with your documents using the power of GPT, 100% privately, no data leaks

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

Awesome-LLM: a curated list of Large Language Model

Doctor Dignity is an LLM that can pass the US Medical Licensing Exam. It works offline, it's cross-platform, & your health data stays private.

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

Inference code for Llama models

LLM Frontend for Power Users.

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Accessible large language models via k-bit quantization for PyTorch.

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback

Foundational Models for State-of-the-Art Speech and Text Translation

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

LLM inference in C/C++

An LLM playground you can run on your laptop

A curated list of practical financial machine learning tools and applications.

Open-source RAG Framework for building GenAI Second Brains 🧠 Build productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic…

A natural language interface for computers

Implementation of Nougat Neural Optical Understanding for Academic Documents

A simple and declarative way to control LLMs

the first library to let you embed a developer agent in your own app!