Fast parallel LLM inference for MLX

Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

4M: Massively Multimodal Masked Modeling

LLM101n: Let's build a Storyteller

Easy token price estimates for 400+ LLMs

Train transformer language models with reinforcement learning.

Build delightful web apps quickly in Python

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models

Implementation for MatMul-free LM.

An Extensible Deep Learning Library

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

A complement to pgvector for high performance, cost efficient vector search on large workloads.

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

YaFSDP: Yet another Fully Sharded Data Parallel

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

Convert PDF to markdown quickly with high accuracy

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

Static Type Checker for Python

Bypassd is a novel I/O architecture that provides low latency access to shared SSDs.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

LLM Benchmark for Throughput via Ollama (Local LLMs)

A Framework of Small-scale Large Multimodal Models

User-friendly WebUI for LLMs (Formerly Ollama WebUI)

ManimML is a project focused on providing animations and visualizations of common machine learning concepts with the Manim Community Library.

A generative speech model for daily dialogue.