This repo aims to collect papers at the crossroads of Large Language Model (LLM) and Evolutionary Computation (EC).

Please make a pull request if you would like your awesome work to be included.

• Papers
  • LLM for EC
  • EC for LLM

1. Mathematical discoveries from program search with large language models
   Bernardino Romera-Paredes, Mohammadamin Barekatain, Alexander Novikov, Matej Balog, M. Pawan Kumar, Emilien Dupont, Francisco J. R. Ruiz, Jordan S. Ellenberg, Pengming Wang, Omar Fawzi, Pushmeet Kohli & Alhussein Fawzi
   Nature 2023 [Paper]
   14 Dec 2023

2. Using Large Language Models for Hyperparameter Optimization
   Michael R. Zhang, Nishkrit Desai, Juhan Bae, Jonathan Lorraine, Jimmy Ba
   arXiv 2023 [Paper]
   7 Dec 2023

3. Algorithm Evolution Using Large Language Model
   Fei Liu, Xialiang Tong, Mingxuan Yuan, Qingfu Zhang
   arXiv 2023 [Paper]
   26 Nov 2023

4. Large Language Models as Evolutionary Optimizers
   Shengcai Liu, Caishun Chen, Xinghua Qu, Ke Tang, Yew-Soon Ong
   arXiv 2023 [Paper]
   29 Oct 2023

5. Large Language Model for Multi-objective Evolutionary Optimization
   Fei Liu, Xi Lin, Zhenkun Wang, Shunyu Yao, Xialiang Tong, Mingxuan Yuan, Qingfu Zhang
   arXiv 2023 [Paper]
   19 Oct 2023

6. Language Model Crossover: Variation through Few-Shot Prompting
   Elliot Meyerson, Mark J. Nelson, Herbie Bradley, Adam Gaier, Arash Moradi, Amy K. Hoover, Joel Lehman
   arXiv 2023 [Paper]
   7 Oct 2023

7. Evoprompting: Language models for code-level neural architecture search
   Angelica Chen, David M. Dohan, David R. So
   arXiv 2023 [Paper]
   28 Feb 2023

8. Enhancing genetic improvement mutations using large language models
   Alexander E.I. Brownlee, James callan, Karine Even-Mendoza, Alina Geiger, Carol Hanna, Justyna Petke, Federica Sarro, Dominik Sobania
   arXiv 2023 [Paper]
   18 Oct 2023

9. Evolving Code with A Large Language Model
   Erik Hemberg, Stephen Moskal and Una-May O'Reilly
   arXiv 2024[Paper]
   13 Jan 2024

1. Plum: Prompt Learning using Metaheuristic
   Rui Pan, Shuo Xing, Shizhe Diao, Xiang Liu, Kashun Shum, Jipeng Zhang, Tong Zhang
   arXiv 2023. [Paper] [Code]
   14 Nov 2023

2. InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operators
   Heng Yang, Ke Li
   arXiv 2023. [Paper] [Code]
   26 Oct 2023

3. Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
   Zihao Lin, Yan Sun, Yifan Shi, Xueqian Wang, Lifu Huang, Li Shen, Dacheng Tao
   arXiv 2023. [Paper]
   4 Oct 2023

4. Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
   Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, Tim Rocktäschel
   arXiv 2023. [Paper]
   28 Sep 2023

5. CONNECTING LARGE LANGUAGE MODELS WITH EVOLUTIONARY ALGORITHMS YIELDS POWERFUL PROMPT OPTIMIZERS
   Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yujiu Yang
   arXiv 2023. [Paper] [Code]
   15 Sep 2023

6. INSTRUCTZERO: EFFICIENT INSTRUCTION OPTIMIZATION FOR BLACK-BOX LARGE LANGUAGE MODELS
   Lichang Chen, Jiuhai Chen, Tom Goldstein, Heng Huang, Tianyi Zhou
   arXiv 2023. [Paper] [Code]
   8 Aug 2023

7. Black-Box Tuning for Language-Model-as-a-Service
   Tianxiang Sun, Yunfan Shao, Hong Qian, Xuanjing Huang, Xipeng Qiu
   arXiv 2022. [Paper] [Code]
   27 Jun 2022

8. Black-box Prompt Tuning for Vision-Language Model as a Service
   Lang Yu, Qin Chen, Jiaju Lin, Liang He
   IJCAI 2023. [Paper] [Code]

9. Prompt Evolution for Generative AI: A Classifier-Guided Approach
   Melvin Wong, Yew-Soon Ong, Abhishek Gupta, Kavitesh Kumar Bali, Caishun Chen
   CAI 2023. [Paper]

10. Black-Box Prompt Learning for Pre-trained Language Models
    Shizhe Diao, Zhichao Huang, Ruijia Xu, Xuechun Li, Yong Lin, Xiao Zhou, Tong Zhang
    arXiv 2023. [Paper] [Code]
    23 Feb 2023

11. Genetic Prompt Search via Exploiting Language Model Probabilities
    Jiangjiang Zhao, Zhuoran Wang, Fangchun Yang
    IJCAI 2023. [Paper] [Code]