PyTorch bindings for CUTLASS grouped GEMM.

The AI Code Editor

LAVIS - A One-stop Library for Language-Vision Intelligence

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

Robust Speech Recognition via Large-Scale Weak Supervision

An Open Source text-to-speech system built by inverting Whisper.

CUDA Templates for Linear Algebra Subroutines

Notes and commented code for RLHF (PPO)

RAG Search API

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

Open weights LLM from Google DeepMind.

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

SGLang is a fast serving framework for large language models and vision language models.

A PyTorch Native LLM Training Framework

Code and example data for the paper: Rule Based Rewards for Language Model Safety

A simple and well styled PPO implementation. Based on my Medium series: https://medium.com/@eyyu/coding-ppo-from-scratch-with-pytorch-part-1-4-613dfc1b14c8.

An educational resource to help anyone learn deep reinforcement learning.

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

OpenAI Baselines: high-quality implementations of reinforcement learning algorithms

Example models using DeepSpeed

LLM Inference analyzer for different hardware platforms

Tool to display AMDGPU usage

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

本项目旨在分享大模型相关技术原理以及实战经验。

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.