Stars
Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"
Train transformer language models with reinforcement learning.
[ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut …
Code and Data for "Long-context LLMs Struggle with Long In-context Learning"
This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen, Carl Vondrick, and Chengzhi Mao.
AdaICL: Which Examples to Annotate of In-Context Learning? Towards Effective and Efficient Selection
ACL'23: Unified Demonstration Retriever for In-Context Learning
OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
Attack to induce LLMs within hallucinations
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
Using sparse coding to find distributed representations used by neural networks.
Universal Neurons in GPT2 Language Models
This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu , Terra Blevins…
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, B…
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]
Do Large Language Models Know What They Don’t Know?