Supercharge Your Model Training

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Evaluate your LLM's response with Prometheus and GPT4 💯

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

DSPy: The framework for programming—not prompting—foundation models

A guidance language for controlling large language models.

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

Train Models Contrastively in Pytorch

A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)

Tools for merging pretrained large language models.

Awesome-LLM-Tabular: a curated list of Large Language Model applied to Tabular Data

A game theoretic approach to explain the output of any machine learning model.

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal

A language for constraint-guided and efficient LLM programming.

Your own notion website with astro

Building a quick conversation-based search demo with Lepton AI.

Structured Text Generation

A curation of awesome tools, documents and projects about LLM Security.

GPT4All: Chat with Local LLMs on Any Device

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

Python bindings for llama.cpp

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

OpenChat: Advancing Open-source Language Models with Imperfect Data

LLM inference in C/C++

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community