The Abstraction and Reasoning Corpus

Examining how large language models (LLMs) perform across various synthetic regression tasks when given (input, output) examples in their context, without any parameter update

official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233

A curated list of awesome open-source libraries for production LLM

A framework for few-shot evaluation of language models.

Alignment with a millennium of moral progress.

This contains code to accompany the paper "A Roadmap to Pluralistic Alignment"

A comprehensive list of PAPERS, CODEBASES, and, DATASETS on Decision Making using Foundation Models including LLMs and VLMs.

A simple unified framework for evaluating LLMs

A library for mechanistic interpretability of GPT-style language models

Papers and resources related to the security and privacy of LLMs 🤖

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

This repository collects all relevant resources about interpretability in LLMs

Matplotlib styles for scientific plotting

A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.

A sample project that exists for PyPUG's "Tutorial on Packaging and Distributing Projects"

Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep

A trivial programmatic Llama 3 jailbreak. Sorry Zuck!

Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding

Chat Templates for 🤗 HuggingFace Large Language Models

A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.

A modern cookiecutter template for Python projects that use Poetry for dependency management

언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

[ACL 2024 WS Oral] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages

Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"