Apply to my task
arXiv:2507.08350 ★ 87 Jul 11, 2025

The Generate-Critique-Revise loop: one model thinking like a whole team

Key result

The fastest way to improve an LLM's answer is to ask the same LLM to tear it apart. This method turns any draft into a polished result with no new tools and no fine-tuning. The gist: split the task into three steps: first a draft, then critique from a specific role ('now you're a skeptical investor'), then a revision that addresses the comments. The trick: diverse critic roles matter more than how many critics you have. 'Critique this as a marketer, then as a lawyer' delivers sharper, more useful critique than three identical viewpoints. Repeat the loop 2-3 times: each iteration adds another layer of polish.

Exploring Design of Multi-AgentLLMDialogues for Research Ideation

Key Aspects of the Research:

The study looks at how structured dialogues between several LLM agents affect the generation of high-quality ideas. The authors built a system where some agents propose ideas, others critique them, and then the first group refines the ideas based on the critique. They compared different setups: the number of critic agents, the depth (number of “critique-revision” cycles), and the diversity of the agents' “personalities” (personas).

Key Result: Using a “Generate-Critique-Revise” loop with several cycles and a diverse set of critic roles significantly boosts both the novelty and the practical feasibility of the ideas, compared with a simple single-LLM request.


The Core of the Method, Explained:

The point of the method is to stop treating the LLM as a vending machine for finished answers and start using it as a partner in an iterative process. Instead of trying to write one perfect, all-encompassing prompt, you break the task into three consecutive stages right inside one conversation:

  1. Generation (Ideation): You give the LLM a clear task to produce a first version, a draft or a set of ideas. That's your starting point.

  2. Critique: You ask the same LLM (or open a fresh chat for a “clean” context) to play critic. This is the most important step. You hand it its own text and ask it to find weak spots, logical gaps and risks, or to suggest improvements. The study shows it's especially effective to make the LLM critique from different perspectives by assigning it different roles (personas). For example: “Now critique this text as a marketer,” “Now as a lawyer.”

  3. Revision: You give the LLM the original text plus all the critique, then issue the final command: “Taking all of these comments into account, rewrite the original text to make it stronger, more logical and more persuasive.”

You can repeat the loop 2-3 times for the best result. The study's main takeaway for users: a structured dialogue with self-critique produces far better results than a single request.


Practical Applicability Analysis:

  • Direct applicability: The method works directly in any chatbot (ChatGPT, Claude, Gemini). The user can manually walk the LLM through the “Generate -> Critique -> Revise” stages. For example, first ask “Write me a sales proposal,” then “Now play a skeptical customer and find 5 weak spots in this proposal,” and finally “Great, now rewrite the proposal so it addresses all 5 objections.”

  • Conceptual value: The study gives the user a key insight: quality comes from a process, not from one brilliant prompt. An LLM can not only generate but also analyze, and from different roles. That helps you see that for complex tasks you need to “make” the model look at the problem from several angles, simulating a team of experts. The finding that critic diversity (different personas) matters most for quality, while generator diversity matters most for novelty, gives real insight into how to steer a creative process.

  • Adaptation potential: The method is completely universal and adapts easily to any complex task where you need not just a quick answer but high quality and careful thinking.

    • How to adapt it:
      1. Define the end goal (write an essay, draft a business plan, plan a trip).
      2. Generation: Write a simple prompt asking for a draft.
      3. Critique: Pick 2-3 key roles whose perspective on the result matters (for a business plan, an “investor” and a “marketer”; for a trip, a “parent with kids” and an “adrenaline junkie”). Ask the LLM to critique the draft from each of those roles.
      4. Revision: Collect all the critical comments and give the command to produce the final version.

A Practical Example:

### **Task: Develop a concept for a new coffee shop in a residential suburb.**

---

#### **STAGE 1: IDEA GENERATION (First prompt)**

You are a creative entrepreneur.
Your task is to develop a concept for a new coffee shop opening in a residential suburb of a big city. Target audience: families with kids, freelancers, and office workers from nearby business parks.

Propose 3 concept options. For each, specify:
1.  **Name:** Short and memorable.
2.  **Core idea (the "hook"):** What will set this coffee shop apart?
3.  **Signature menu items:** 2-3 items that reflect the concept.
4.  **Atmosphere:** What the interior will look like and what the vibe will be.

---

#### **STAGE 2: IDEA CRITIQUE (Second prompt, after you get the answer to the first)**

Great. Now switch roles.

You are an **experienced and very pragmatic investor** deciding whether to put money into these concepts. I'll give you 3 ideas that your colleague came up with.

Your task is to **critique each of the 3 concepts harshly but constructively**. For each idea, find potential weak spots, risks and gaps.

Pay attention to:
- **Financial viability:** Is the "hook" too expensive to pull off? Will it make money?
- **Audience reach:** Will the concept scare off one part of the audience while trying to attract another?
- **Operational complexity:** How hard will it be to keep this concept running day to day?

Here are the ideas to critique:
`[The user pastes the LLM's answer from stage 1 here]`

---

#### **STAGE 3: IDEA REVISION (Third prompt)**

Excellent analysis. You're the creative entrepreneur again.

You've received valuable feedback from an investor. Your task is to **pick the single most promising concept of the three and refine it** so it addresses all of the investor's objections and concerns.

Create a final, improved version of the concept. In the description, state separately **exactly how you addressed each point** of the investor's critique to make the idea stronger and more viable.

Here are the original ideas:
`[The user pastes the original answer here again]`

And here is the investor's critique:
`[The user pastes the answer from stage 2 here]`

Why It Works:

This prompt works because it puts the study's key findings into practice:

  1. Task decomposition: The complex task “come up with a successful coffee shop” is split into logical steps: generation, risk analysis and synthesis of an improved solution. That prevents shallow answers.
  2. Simulating a multi-agent dialogue: The user has the LLM play two different roles in turn: a creative generator and a pragmatic critic. This mimics the “Ideation-Critique” loop proposed in the paper.
  3. Using personas for quality critique: The “experienced investor” role makes the model focus on specific aspects (finances, operations, risks), so the critique is targeted and useful rather than generic. This directly applies the finding that a specialized critic raises the quality and feasibility of an idea.
  4. Iterative improvement: The final prompt makes the model not just rewrite the text but synthesize a new version from the original data and the critique. That taps into the LLM's more advanced “reasoning” abilities and produces a more thoughtful, balanced result.

Another Practical Example

### **Task: Plan a 5-day vacation in Lisbon for a couple.**

---

#### **STAGE 1: GENERATION (First prompt)**

Act as an experienced travel agent.
Draft a 5-day trip to Lisbon for a young couple (ages 25-30). They love history, great food and beautiful views, but don't want to spend the whole time in museums. Mid-range budget.

Present the plan as a table: Day 1, Day 2, etc. For each day, briefly describe:
- Morning (1-2 activities)
- Afternoon (1-2 activities)
- Evening (a dinner and evening option)

---

#### **STAGE 2: CRITIQUE (Second prompt)**

Thanks. Now you need to play two different roles and critique this plan.

**Role 1: "Budget traveler"**
Analyze the plan from a budget standpoint. Point out which activities or places might be too expensive. Suggest cheaper but just as interesting alternatives. Find spots where they could save on transportation or food.

**Role 2: "Fan of spontaneity and downtime"**
Analyze the plan for pace and workload. Is it overloaded? Is there time for spontaneous walks, lingering in cafes, or just doing nothing? Point out the most exhausting days or transfers.

Here is the plan to critique:
`[The user pastes the LLM's answer from stage 1 here]`

---

#### **STAGE 3: REVISION (Third prompt)**

Great work. You're the travel agent again.
You've received important feedback from clients with different priorities.

Your task is to create a final, balanced trip plan that takes both opinions into account. It should be interesting, but not too expensive and not overloaded.

In the new plan, show explicitly what changes you made to address the wishes of the "budget traveler" and the "fan of spontaneity".

Here is the original plan:
`[The user pastes the original answer here again]`

And here is the critique:
`[The user pastes the answer from stage 2 here]`

Why This Example Works.

This example applies the study's methodology effectively to a practical everyday task:

  1. Modeling diverse critics: Instead of one critic, as in the first example, it uses two different personas, both relevant to the task: the “budget-minded” one and the “downtime lover.” This directly embodies the paper's key finding that diversity in the critic team (Agent Diversity) improves the final result.
  2. Surfacing and resolving conflicts: The personas have potentially conflicting goals (save money vs. relax in comfort). By having the LLM first surface these conflicts (in the critique step) and then resolve them (in the revision step), the user triggers a more sophisticated reasoning process. The model has to find a compromise, which leads to a more realistic, useful plan.
  3. Raising practical value (Feasibility): Critique on specific parameters (budget, pace) directly increases the plan's “feasibility,” as the study showed. The draft might just be a list of sights; the final version is a real itinerary that accounts for human factors like fatigue and budget.
  4. Structured process: As in the previous example, the strict three-stage structure guides the LLM and keeps it from drifting off or giving a shallow answer. Each step builds on the last, creating a chain of reasoning and improvements.

Usefulness Score: 92

02

Main Evaluation Criteria

  • A. Relevance to prompting techniques: Yes, the study offers a concrete interaction structure (Ideation-Critique-Revision) that users can simulate in a chat to get better results.
  • B. Better conversational answers: Yes, the study directly measures and demonstrates gains in the novelty and practical feasibility of ideas, which translates into better, more thoughtful answers.
  • C. Direct practical applicability: Yes, the principles work without code. The user can feed the LLM prompts for generation, then critique (from different perspectives), then revision.
  • D. Conceptual value: Very high. The study gives the user a powerful mental model: an LLM isn't an oracle but a tool for a guided dialogue. Quality is born from iterative critique, not from one perfect prompt.
  • E. New useful practice: The work fits several clusters at once:
    • Cluster 1 (Phrasing techniques): Offers the “Ideate-Critique-Revision” meta-technique, a form of decomposition and role play.
    • Cluster 2 (Behavioral patterns): Reveals important patterns, such as diminishing returns after 3 iterations and the different effects of role diversity (critics improve quality, generators improve novelty).
    • Cluster 7 (Reliability and stability): The critique method directly targets higher feasibility and fewer “hallucinations” or impractical suggestions.
  • Practicality checklist (+15 points): Yes, the study provides a structure for complex requests, reveals non-obvious LLM behavior, and offers a way to improve answer accuracy and quality.
03

Numerical Usefulness Score

Arguments for the score (92/100): The study offers not just a “trick” or a magic phrase but a fundamental, universal process for getting high-quality results from an LLM. The “Generate-Critique-Revise” method is intuitive and any user can easily simulate it in a regular chat. Its key findings (e.g., “2-3 critique iterations are optimal” or “diverse critics improve quality”) are direct, ready-to-use instructions for advanced prompting. The conceptual value is huge, since it shifts the user's focus from hunting for the “perfect prompt” to building an “effective process” for working with the model.

Counterarguments (why the score could differ): * Why it could be lower (say, 80-85): The study is written in an academic style and talks about “multi-agent systems,” which may put off an everyday user. To apply the method, the user has to figure out on their own that this complex process can be simulated in a single chat by changing the LLM's instructions step by step. The paper doesn't give a ready-made “prompt template”; it describes a methodology that takes some thought and adaptation. * Why it could be higher (say, 95-98): This approach is one of the most powerful ways to tackle complex creative and analytical tasks. It fundamentally changes the paradigm of working with LLMs. A user who understands and masters this method will see their results improve by an order of magnitude, which makes the study extremely valuable.


Research digest

Key result

The fastest way to improve an LLM's answer is to ask the same LLM to tear it apart. This method turns any draft into a polished result with no new tools and no fine-tuning. The gist: split the task into three steps: first a draft, then critique from a specific role ('now you're a skeptical investor'), then a revision that addresses the comments. The trick: diverse critic roles matter more than how many critics you have. 'Critique this as a marketer, then as a lawyer' delivers sharper, more useful critique than three identical viewpoints. Repeat the loop 2-3 times: each iteration adds another layer of polish.

Principle

This isn't about 'write a better prompt'; it's about switching the model's mode of work. An LLM in generator mode is an optimist. In critic mode with a clear point of view, it's a surgeon. The process is straightforward: draft → critique from role A → critique from role B → final revision that addresses both. Give the critic a specific role and you get a specific pain point to fix. 'Find the flaws' gets you fluff. 'You're a CFO who has to sign off on the budget: find the holes' gets you a list of real risks.

Why it works

The model can't invent and doubt at the same time. Those are different modes of thinking, and it gets muddled if you drag both into one prompt. Splitting the task into roles removes that conflict. The study found something non-obvious: diversity in critic roles drives the quality and feasibility of ideas, while diversity in generator roles drives novelty. That gives you a practical steering wheel: want a sturdier idea, change the critic. Want a more original one, change the generator.

When to apply

Any task where the draft is just a starting point: business plans, articles, sales proposals, product concepts, scripts, training programs. It works especially well when you need to address the objections of a specific audience; that audience becomes the critic's role. NOT a fit for: quick factual questions and tasks with a single right answer, where the loop adds nothing but wasted time.

Mini recipe

1. Run the generator: give it a role and a task, e.g. experienced product manager, and ask for a draft concept, article or plan. 2. Switch to a critic with a specific role: after the answer, send a new prompt. 'You're now [role]. Here's the text. Find the weak spots, focusing on [a specific aspect: money, the user, risks].' 3. Add a second critic with a different viewpoint: same structure, different role. The first critic thinks about money; the second about the user or competitors. 4. Run the revision: give the model the original plus all the critique. Say: 'Address all the comments and create a final version. Explain what changes you made and why.' 5. Repeat the loop if needed: if you're still not happy with the result, run another round of critique. The study shows 2-3 cycles give a noticeable boost.

Examples

[BAD]: `Write a sales proposal for our reporting automation service` [GOOD]: three separate prompts in a row. Prompt 1 — generation: `You're an experienced B2B software sales manager. Write a draft sales proposal for a financial reporting automation service. Target audience: CFOs at companies with 50+ employees.` Prompt 2 — critique: `You're the CFO of a mid-sized manufacturing company. Someone just sent you this sales proposal. Find 5 specific reasons you'd toss it in the trash: what's unconvincing, what's missing, where's the trust gap? Here's the text: [paste the answer from prompt 1]` Prompt 3 — revision: `You're the sales manager again. Here's the original proposal [paste] and here's the CFO's critique [paste]. Rewrite the proposal so it addresses every objection. Next to each change, note in parentheses which point of the critique it addresses.`

In plain words

Here's the deal: a single AI agent, no matter how smart, quickly hits the ceiling of its own patterns and starts churning out clichés. This study shows that to squeeze genuinely fresh ideas out of AI, you need several models to argue with and build on each other. It's not just a chat; it's a structured dialogue where every agent has its own role, its own limits and its own area of responsibility. When you pit them against each other, they stop agreeing with the first option that comes along and start digging deeper, pulling out non-obvious connections that a lone ChatGPT would simply skip.

It's like putting a brilliant marketer, a nitpicky finance guy and a creative designer in one room to come up with a coffee shop concept. Ask them one at a time and you get three boring reports. But make them critique each other's ideas in real time, and something alive is born where their conflicts collide. One pitches pink walls, the second counts every penny, and the third reminds everyone that suburban folks want coziness, not Instagram bait. The result is a project that will actually survive, not just look pretty on paper.

The method rests on three pillars: role separation, iterative critique and synthesis of contradictions. First you give the agents strict roles: one champions innovation, another argues for down-to-earth pragmatism. Then the feedback loop kicks in: agent A lays down the base, agent B hunts for weak spots, and agent C tries to glue it all into a working plan. The study found that negative feedback between models is what raises idea quality by 30-40%, because the AI has to defend itself and nail down details instead of hallucinating into the void.

The researchers ran this method on scientific hypotheses, but the principle is completely universal. You can and should plug it into any business process: naming a new brand, designing software architecture, planning a marketing strategy. Anywhere you need brainstorming without the human factor (laziness, fear of hurting a colleague's feelings, or tired eyes), multi-agent systems outperform standard prompts by a mile. It's a shift from the “question-answer” model to a “mini-lab in one window” model.

Bottom line: quit torturing a single chat with endless follow-ups; that road leads nowhere. The future is agent orchestration, where you're not the author but the conductor of this digital circus. If you don't learn to pit models against each other in search of the truth, you'll keep getting painfully average results. Multi-agent dialogue is the only way to make AI actually think instead of just imitating common sense. Whoever masters this now gets an endless source of out-of-the-box solutions for pennies.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on The Generate-Critique-Revise loop: one model thinking like a whole team arXiv:2507.08350

Sign in to apply this study New accounts get 50 free credits.

Get the week’s best papers by email

One email on Sundays with the highest-rated new techniques. Unsubscribe with one click.