A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.

A collaborative LLM-human evaluation pipeline COEVAL.

Let ChatGPT teach your own chatbot in hours with a single GPU!

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Code and documentation to train Stanford's Alpaca models, and generate the data.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Failure archive for ChatGPT and similar models

Repo for external large-scale work

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/

A LLM based research assistant that allows you to have a conversation with a research paper

Making large AI models cheaper, faster and more accessible

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥

ACL 2022 Findings

A modular RL library to fine-tune language models to human preferences

An elegant PyTorch deep reinforcement learning library.

Awesome papers on Language-Model-as-a-Service (LMaaS)

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

Stable Diffusion web UI

GLM (General Language Model)

Tips for releasing research code in Machine Learning (with official NeurIPS 2020 recommendations)

Evaluation code for various unsupervised automated metrics for Natural Language Generation.

程序员延寿指南 | A programmer's guide to live longer