Agentic components of the Llama Stack APIs

YaRN: Efficient Context Window Extension of Large Language Models

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

The simplest open-source implementation of perplexity.ai

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

DSPy: The framework for programming—not prompting—foundation models

Self-hosted AI coding assistant

PyTorch native finetuning library

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

Code for the paper Fine-Tuning Language Models from Human Preferences

A guidance language for controlling large language models.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Using GPT to parse PDF

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

A generative speech model for daily dialogue.

PyTorch bindings for CUTLASS grouped GEMM.

llama3 implementation one matrix multiplication at a time

TorchCFM: a Conditional Flow Matching library

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

Make awesome display tables using Python.

Kolmogorov Arnold Networks

Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper

Continual Learning of Large Language Models: A Comprehensive Survey

open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality

The official Meta Llama 3 GitHub site