Awesome-Efficient-LLM: A curated list for Efficient Large Language Models

[irthomasthomas]

• horseee/Awesome-Efficient-LLM: A curated list for Efficient Large Language Models

Awesome-Efficient-LLM

A curated list for Efficient Large Language Models:

• Knowledge Distillation
• Network Pruning
• Quantization
• Inference Acceleration
• Efficient MOE
• Text Compression
• Low-Rank Decomposition
• Hardware/System Tuning
• Survey
• Leaderboard
• 🚀 Updates
• Contributing

---

Inference Acceleration

• …
• Add your paper here, generate the required format, and submit a pull request.

---

Updates

• Sep 27, 2023: Add tag for papers accepted at NeurIPS'23.
• Sep 6, 2023: Add a new subdirectory project/ to organize those projects designed for developing a lightweight LLM.
• July 11, 2023: Create a new subdirectory efficient_plm/ for papers applicable to PLMs (such as BERT, BART) but have yet to be verified for their effectiveness on LLMs.

---

Contributing

If you'd like to include your paper or need to update any details, please feel free to submit a pull request. You can generate the required markdown format for each paper by filling in the information in generate_item.py and execute python generate_item.py. We warmly appreciate your contributions to this list. Alternatively, you can email me with the links to your paper and code, and I would add your paper to the list at my earliest convenience.

• URL: https://github.com/horseee/Awesome-Efficient-LLM#inference-acceleration

Suggested labels

{ "label-name": "efficient-llm-acceleration", "description": "Inference acceleration techniques for efficient large language models.", "repo": "horseee/Awesome-Efficient-LLM", "confidence": 70.8 }