Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.

A high-throughput and memory-efficient inference and serving engine for LLMs

A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.

Tools for merging pretrained large language models.

Must-read Papers on Knowledge Editing for Large Language Models.

A simple and effective LLM pruning approach.

Official repository of Evolutionary Optimization of Model Merging Recipes

Representation Engineering: A Top-Down Approach to AI Transparency

LLM101n: Let's build a Storyteller

A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..

Daily updated LLM papers. 每日更新 LLM 相关的论文，欢迎订阅 👏 喜欢的话动动你的小手 🌟 一个

📋 A list of open LLMs available for commercial use.

Mamba SSM architecture

Awesome-LLM: a curated list of Large Language Model

LLM training in simple, raw C/CUDA

A curated list of Early Exiting papers, benchmarks, and misc.

This repository contains a collection of papers and resources on Reasoning in Large Language Models.

[NeurIPS-2020] Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID.

[TMLR 2024] Efficient Large Language Models: A Survey

Awesome LLM compression research papers and tools.

Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467

Pytorch implementation of various Knowledge Distillation (KD) methods.

The data for the CRASS-benchmark

A paper & resource list of large language models, including course, paper, demo, figures

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed