Examples and guides for using the OpenAI API

Anthropic's educational courses

Simple language-driven navigation tasks for studying compositional learning

Recipes to train reward model for RLHF.

Evaluating text-to-image/video/3D models with VQAScore

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vector…

Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models

SGLang is a fast serving framework for large language models and vision language models.

Chat Templates for 🤗 HuggingFace Large Language Models

A high-throughput and memory-efficient inference and serving engine for LLMs

Multimodal Analytics

Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas

An Awesome list of curated DSPy resources.

DSPy: The framework for programming—not prompting—foundation models

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

Lime: Explaining the predictions of any machine learning classifier

This repository contains data, code and models for contextual noncompliance.

CLIPScore EMNLP code

A robust Python tool for text-based AI training and generation using GPT-2.

Code and data for paper "Do they mean ‘us’? Interpreting Referring Expressions in Intergroup Bias"

Examples and guides for using the Gemini API.

Official Repository for the ACL 2024 Paper: Unintended Impacts of LLM Alignment on Global Representation

Code for the Clinical NLP @ NAACL 2022 Paper: What Do You See in this Patient? Behavioral Testing of Clinical NLP Models

Repository for the Bias Benchmark for QA dataset.