This repo aims to record survey of LLM, including instruction tuning, human alignment, LLM agent, hallucination, multi-modal, etc.
We strongly encourage the researchers that want to promote their fantastic work to the LLM survey community to make pull request to update their paper's information!
- Awesome-LLM-Survey
-
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4, 2023.10 [paper]
-
Challenges and Applications of Large Language Models, 2023.07 [paper]
-
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond, 2023.04 [paper][project]
-
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT, 2023.02 [paper]
- Vision-Language Instruction Tuning: A Review and Analysis, 2023,11 [paper][project]
- Instruction Tuning for Large Language Models: A Survey, 2023.08 [paper]
-
AI Alignment: A Comprehensive Survey, 2023.10 [paper][project]
-
Large Language Model Alignment: A Survey, 2023.09 [paper]
-
From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Model, 2023.08 [paper][project]
-
Aligning Large Language Models with Human: A Survey, 2023.07 [paper][project]
-
Towards Better Chain-of-Thought Prompting Strategies: A Survey, 2023.10 [paper]
-
A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future, 2023.09 [paper][project]
-
Prompting Frameworks for Large Language Models: A Survey, 2023.11 [paper][project]
-
Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review, 2023.10 [paper]
- A Survey on Retrieval-Augmented Text Generation, 2022.02 [paper]
-
Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey, 2023.11 [paper]
-
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions, 2023.11 [paper][project]
-
A Survey of Hallucination in “Large” Foundation Models, 2023.09 [paper][project]
-
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models, 2023.09 [paper][project]
-
Cognitive Mirage: A Review of Hallucinations in Large Language Models, 2023.09 [paper][project]
- A Survey on Model Compression for Large Language Models, 2023.08 [paper]
-
Evaluating Large Language Models: A Comprehensive Survey, 2023.10 [paper][project]
-
A Survey on Evaluation of Large Language Models, 2023.07 [paper][project]
- Explainability for Large Language Models: A Survey, 2023.09 [paper]
- A Survey on Fairness in Large Language Models, 2023.08 [paper]
- A Survey of Graph Meets Large Language Model: Progress and Future Directions, 2023.11 [paper]
- Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey, 2023.11 [paper]
-
A Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity, 2023.10 [paper][project]
-
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models, 2023.10 [paper]
-
Knowledge Unlearning for LLMs: Tasks, Methods, and Challenges, 2023.11 [paper]
-
Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications, 2023.11 [paper]
-
Knowledge Editing for Large Language Models: A Survey, 2023.10 [paper]
-
Editing Large Language Models: Problems, Methods, and Opportunities, 2023.05 [paper][project]
-
Foundation Models for Decision Making: Problems, Methods, and Opportunities, 2023.03 [paper]
-
Augmented Language Models: a Survey, 2023.02 [paper]
- A Survey of Language Model Confidence Estimation and Calibration, 2023.11 [paper]
-
A Survey on Large Language Model based Autonomous Agents, 2023.08 [paper][project]
-
The Rise and Potential of Large Language Model Based Agents: A Survey, 2023.09 [paper][project]
-
Vision-Language Instruction Tuning: A Review and Analysis, 2023,11 [paper][project]
-
How to Bridge the Gap between Modalities: A Comprehensive Survey on Multimodal Large Language Model, 2023.11 [paper]
-
A Survey on Multimodal Large Language Models, 2023.06 [paper][project]
-
A Survey on Language Models for Code, 2023.11 [paper][project]
-
Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey, 2023.10 [paper][project]
-
Large Language Models Meet NL2Code: A Survey, 2022.12 [paper]
-
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge, 2023.11 [paper][project]
-
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review, 2023.10 [paper][project]
-
Large AI Models in Health Informatics: Applications, Challenges, and the Future, 2023.03 [paper][project]
- Large Language Models in Finance: A Survey, 2023.09 [paper]
- ChatGPT and Beyond: The Generative AI Revolution in Education, 2023.11 [paper]
- A Survey on Large Language Models for Personalized and Explainable Recommendations, 2023.11 [paper]
- Large Language Models for Generative Recommendation: A Survey and Visionary Discussions, 2023.09 [paper]
- A Survey on Large Language Models for Recommendation, 2023.08 [paper][project]
- How Can Recommender Systems Benefit from Large Language Models: A Survey, 2023.06 [paper][project]
- Large Language Models for Software Engineering: Survey and Open Problems, 2023.10 [paper]
- Large Language Models for Software Engineering: A Systematic Literature Review, 2023.08 [paper]
- A Survey on Multimodal Large Language Models for Autonomous Driving, 2023.11 [paper]
- A Survey of Large Language Models for Autonomous Driving, 2023.11 [paper][project]
- Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook, 2023.10 [paper][project]