An Experiment on Dynamic NTK Scaling RoPE

Improving Text Embedding of Language Models Using Contrastive Fine-tuning

Doing simple retrieval from LLM models at various context lengths to measure accuracy

Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty

LongQLoRA: Extent Context Length of LLMs Efficiently

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models

Fast Memorization of Prompt Improves Context Awareness of Large Language Models

Code for paper Towards Mitigating LLM Hallucination via Self Reflection

A library for efficient patching and automatic circuit discovery.

A comprehensive survey on Internal Consistency and Self-Feedback in Large Language Models, including theoretical frameworks, task classifications, evaluation methods, future research directions and…

A modular graph-based Retrieval-Augmented Generation (RAG) system

AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension

The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.

Code for Quiet-STaR

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

A framework for few-shot evaluation of language models.

Official repo for "Make Your LLM Fully Utilize the Context"

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

[ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning

Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation