[2309.16797] Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution

Popular prompt strategies like Chain-of-Thought Prompting can dramatically improve the reasoning abilities of Large Language Models (LLMs) in various domains. However, such hand-crafted prompt-strategies are often sub-…

Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution Chrisantha Fernando Dylan Banarse Henryk Michalewski Simon Osindero Tim Rocktäschel Google DeepMind {chrisantha,dylski,henrykm,osindero,rocktaschel}@google.com Abstract Popular prompt strategies like Chain-of-Thought Prompting can dramatically improve the reasoning abilities of Large Language Models (LLMs) in various domains. However, such hand-crafted prompt-strategies are often sub-optimal. In this paper, we present Promptbreeder , a general-purpose self-referential self-improvement mechanism that evolves and adapts prompt

related reading

• [2309.16797] Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutionarxiv.org
• [2507.19457] GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningarxiv.org
• 2402.07927arxiv.org
• Harness Engineering for Self-Improvement | Lil'Loglilianweng.github.io
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Meta-Prompt: A Simple Self-Improving Language Agentnoahgoodman.substack.com
• As Rocks May Think | Eric Jangevjang.com
• Can LLMs Critique and Iterate on Their Own Outputs? | Eric Jangevjang.com
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• Prompt Engineering Guide | Prompt Engineering Guidepromptingguide.ai
• LLMs Can Self-Improvearxiv.org
• [2206.08896] Evolution through Large Modelsarxiv.org