Apply to my task
arXiv:2507.17753 ★ 80 May 2, 2025

Role duet: the "peer checks peer" setup is more accurate than a single agent or a hierarchical pair

Key result

Same model, same chat, but the second request is written as an equal colleague, not a boss. Sounds trivial. Yet that's exactly what works best. The method lets you simulate two independent experts in a regular chat, with no extra tools or fine-tuning. The trick is the balance of power: the "teacher → student" setup loses to "peer ↔ peer". An equal has no need to agree out of politeness, so the model starts genuinely critiquing instead of rubber-stamping.

Exploring Communication Strategies for CollaborativeLLMAgents in Mathematical Problem-Solving

Key Aspects of the Research:

The researchers compared how two LLMs (GPT-4o) talking to each other in different roles solve hard math problems. They found that any collaboration between two "agents" beats a single agent, and the most accurate results come when the agents interact as equal partners ("peer-to-peer"), checking and building on each other's work.

Key Result: Collaboration between two LLM agents acting as equal partners (peer-to-peer) is the most effective way to solve complex problems.


The Core of the Method, Explained:

The core idea is to stop treating an LLM as a single "monolithic" mind and start using it as a team of several "virtual specialists" with different roles. The study shows that if you make the model first generate an answer in one role and then critique or extend it in another, you can significantly improve the quality and accuracy of the final result.

Here's what the practical method looks like for a user:

  1. Step 1: Generation (Role 1, "the Doer"). You give the LLM its first role (for example, "Marketer," "Screenwriter," "Analyst") and ask it to do the main part of the task: write a text, draft a plan, analyze data.
  2. Step 2: Critique and Improvement (Role 2, "the Peer Critic"). You take the answer and, in the next prompt, give the LLM a new role. According to the study, the most effective role is an "equal partner" or "colleague." You ask the "second agent" to review the "first agent's" work, find weak spots, missed opportunities and logic errors, and suggest specific improvements toward the shared goal.
  3. Step 3: Synthesis. If needed, you ask the model to combine the best of the original version and the critic's suggestions into a final, improved answer.

This approach makes the model engage different reasoning patterns, which helps catch and fix errors that a "solo" pass is prone to.


Practical Applicability Analysis:

  • Direct applicability: Very high. Users can simulate this process in any chatbot. All it takes is writing prompts one after another in the same conversation, assigning the LLM different roles. For example: "First, act as a creative copywriter and write an ad. ... [get the answer] ... Now you're a pragmatic editor. Check this text against the brief and find the weak spots."

  • Conceptual value: Huge. The study shows that an LLM is prone to "cognitive biases" and "tunnel vision," just like a person. By making it switch roles, we force it to look at the problem from a new angle, which is a powerful self-correction mechanism. Users stop thinking like "question-askers" and start thinking like "managers of a team of virtual experts."

  • Adaptation potential: The method is universal and adapts easily to any complex task where accuracy and completeness matter.

    • Writing: The roles "Creative Writer" and "Strict Editor."
    • Business planning: The roles "Optimistic Strategist" and "Pessimistic Financial Analyst (devil's advocate)."
    • Programming: The roles "Developer Writing the Code" and "Tester Hunting for Bugs and Edge Cases." The adaptation mechanism is simple: identify two complementary or conflicting perspectives on your task and assign them to the LLM as consecutive roles.

A Practical Example:

### **Prompt 1: Role "Creative Marketer"**

**Role:** You are an experienced creative marketer working at an agency. Your style is bold, vivid and emotional.

**Task:** Develop an ad campaign concept for a new product: the "AquaMind" smart water bottle, which tracks water intake and reminds you to drink with light signals.

**Target audience:** Young professionals aged 25-40 who care about their health but often forget to drink water because they're busy.

**What to do:**
1.  Come up with the campaign's main slogan.
2.  Describe the core idea for a 30-second commercial.
3.  Suggest 3 ideas for social media posts.

**Response format:** Structure your answer as a list of points.

(After getting the LLM's answer, the user copies it and uses it in the next prompt)

### **Prompt 2: Role "Analyst Partner" (Peer-to-Peer)**

**Role:** Now you are another marketer at the same agency, equal to your colleague in experience and status. Your strengths are pragmatism, analytics and a focus on concrete value for the client.

**Context:** Your colleague has proposed a creative concept for the "AquaMind" bottle ad campaign. Your shared goal is to make the campaign as strong and persuasive as possible.

**Task:** Review the proposed concept and act as a constructive partner.

**Here is your colleague's concept:**


**What to do:**
1.  **Evaluate the slogan:** How clear and persuasive is it for the target audience? Is there a risk it could be misunderstood? Suggest your own, more pragmatic version.
2.  **Analyze the commercial idea:** Is it too abstract? Does it clearly show the *problem* (forgetfulness, dehydration) and its *solution* with the bottle?
3.  **Review the social media posts:** What specific numbers or facts about the benefits of hydration could you add to make them more convincing?
4.  **Write up final recommendations:** Suggest 2-3 specific improvements to balance creativity and practical value in the campaign.

Why It Works:

This approach works by simulating "peer-to-peer collaboration," the most effective mode in the study.

  1. Two different "mental models": The first prompt activates the LLM's patterns tied to creativity and emotion ("bold, vivid"). The second prompt forces it to switch to a completely different set of patterns: analytics, pragmatism and hunting for flaws ("a focus on concrete value").
  2. Constructive criticism: Prompt 2 doesn't just ask the model to "check it"; it gives clear instructions for the critique ("how clear is it?", "is it too abstract?"), pointing the model's attention at potential weak spots.
  3. A shared goal: The line "Your shared goal is to make the campaign as strong as possible" sets the LLM up to collaborate rather than simply shoot things down, which matches the spirit of "peer-to-peer" interaction. It makes the model not only find errors but also suggest ways to fix them.

Another Practical Example

### **Prompt 1: Role "Travel Enthusiast"**

**Role:** You are an experienced traveler and blogger. You love putting together packed itineraries full of experiences.

**Task:** Create a detailed 7-day trip plan to Lisbon for a young couple (28-30) going there for the first time. They love history, great food and beautiful views. Mid-range budget.

**What to do:**
*   Lay out a plan for each of the 7 days.
*   Include iconic landmarks, off-the-beaten-path spots, restaurant recommendations and evening entertainment.
*   Make the plan as interesting and packed as possible.

(After getting the LLM's answer)

### **Prompt 2: Role "Pragmatic Partner" (Peer-to-Peer)**

**Role:** Now you are one of the people on this trip. You love your enthusiastic partner, but you approach planning more practically. You value comfort, hate rushing and make sure the vacation doesn't turn into a marathon.

**Context:** Your partner has put together a very packed plan for the Lisbon trip. Together you want to refine it so it's perfect for both of you.

**Task:** Review the proposed plan in terms of realism and comfort.

**Here is your partner's plan:**


**What to do:**
1.  **Assess the pace:** Which days look overloaded? Where could you cut or swap things to avoid rushing and exhaustion?
2.  **Check the logistics:** How easy is it to get between the suggested spots on the same day? Are there better routes?
3.  **Add downtime:** Where in the plan could you add free time to just sit in a café, wander aimlessly or rest at the hotel?
4.  **Offer compromises:** Write up a final, more balanced and realistic plan that keeps the sense of adventure but is more comfortable.

Why This Example Works: The Mechanism.

This example succeeds on the same principles as the study, adapted to a planning task.

  1. A change of perspective: The first prompt generates an "idealistic" plan with as many activities as possible. The second prompt makes the LLM look at the same plan from the standpoint of a "realist" who cares about pace, logistics and rest. These are two different but equally important viewpoints.
  2. Surfacing hidden problems: The "pragmatist" role is aimed squarely at finding problems the "enthusiast" might have ignored: fatigue, unrealistic timing, transportation hassles.
  3. Joint refinement (Collaboration): Prompt 2 doesn't just ask to cross things out; it asks to "offer compromises" and create "a more balanced plan." This makes the LLM synthesize a new, improved version that combines the strengths of both approaches, which is the essence of effective "peer-to-peer" interaction.

Usefulness Score: 93

02

Main Evaluation Criteria

  • A. Relevance to prompting techniques: Yes. The study directly examines the effectiveness of different role setups ("teacher-student," "peers") defined through prompts. This is a fundamental prompt-engineering technique.
  • B. Better answers: Yes. It shows that the two-agent approach improves problem-solving accuracy (from 47% to 54%), and the "peer" (peer-to-peer) mode is the most effective.
  • C. Direct practical applicability: Yes. While an everyday user can't run two agents at once, they can easily simulate the process in a single chat by giving the LLM different roles in sequence for generating and then critiquing an answer. No code or special tools needed.
  • D. Conceptual value: Very high. The study gives users a powerful mental model: for complex tasks, an LLM works better as a "team of specialists" than as an oracle. It proves the value of iterative critique and joint refinement, explaining why prompts like "check your work" or "act as a critic" are so effective.
  • E. A useful new practice: The paper fits several clusters:
    • Cluster 1 (Phrasing techniques): Explicitly uses and compares role-play techniques.
    • Cluster 2 (Behavioral patterns): Shows that an LLM, like a human, benefits from a "second opinion," which leads to more accurate results.
    • Cluster 7 (Reliability and stability): The method's main goal is to improve accuracy and reduce errors (hallucinations) through cross-checking.
  • Practicality checklist (+15 points): Provides ready-made prompt constructions (role descriptions), shows how to structure complex requests (through dialogue), reveals non-obvious LLM behavior (peer-to-peer beats teacher-student) and offers a way to improve accuracy. That's +15 points on top of the base score.
03

Numerical Usefulness Score

Arguments for a high score (93/100): The study provides scientific backing for one of the most powerful advanced prompting techniques: simulating several roles to solve one task. It doesn't just say "do it this way"; it proves why it works and identifies which mode of interaction ("peers") is most effective. The finding that equal-footing collaboration (peer-to-peer) gives the best results is a concrete, practical insight you can use right away to improve answers to complex requests. An everyday user can easily adapt the method within a single chat.

Counterarguments (why the score could be lower): * Narrow testing scope: The study focuses on solving math problems. The principles are probably universal, but this paper doesn't prove their effectiveness for creative or humanities tasks. * Requires adaptation: The method is described for a two-agent system, and users have to figure out on their own how to simulate it in a regular chat. That's a small step from direct application to adaptation. * More effort: The approach takes at least two consecutive prompts instead of one, plus reviewing the intermediate results, which makes working with the LLM more complex and time-consuming.


Research digest

Key result

Same model, same chat, but the second request is written as an equal colleague, not a boss. Sounds trivial. Yet that's exactly what works best. The method lets you simulate two independent experts in a regular chat, with no extra tools or fine-tuning. The trick is the balance of power: the "teacher → student" setup loses to "peer ↔ peer". An equal has no need to agree out of politeness, so the model starts genuinely critiquing instead of rubber-stamping.

Principle

Two passes with different roles, and that's it. No need to overcomplicate. First, the model solves the task as the "doer" with its own style and angle. Then it gets the same task and its own answer, but this time in the role of an equal partner with different priorities. The key: the second agent must be equal in status, not higher up. Not "a senior editor reviews the text" but "another editor with the same experience looks at the same text." That kills the default "eh, good enough" and switches on real constructive skepticism. The A→B→C logic: — A: the first agent generates a solution — B: the second agent, a "peer," looks for weak spots and suggests improvements — C: if needed, a synthesis of the best of both

Why it works

An LLM gets stuck on its first answer. It's not a bug, it's a pattern: the model locks in its line of reasoning early and follows it to the end, even if it took a wrong turn somewhere. Call it "tunnel vision." Switching roles breaks the tunnel. The model literally swaps sets of reasoning patterns: what the "marketer" took as obvious, the "analyst" questions. That's why equal roles beat hierarchical ones: a peer has no social motive to agree, so the model isn't looking for confirmation, it's looking for problems. An important caveat: the study was done on math problems with two separate copies of GPT-4o. You're doing it sequentially in one chat, which is a close simulation but not the same thing. It still works in practice; just keep that in mind.

When to apply

Any task where the first pass is almost never perfect, especially when the cost of a mistake is high. Writing and editing → the "author" role + an "editor with different taste" role. Business analysis → an "optimistic strategist" role + a "financial skeptic" role. Code → a "developer writing the solution" role + a "tester hunting for edge cases" role. Planning → an "enthusiast cramming in activities" role + a "pragmatist watching the pace" role. NOT a fit for: simple, unambiguous tasks ("translate this text," "add up these numbers"). There a second pass adds nothing and just wastes time.

Mini recipe

1. Define two roles: find a pair of perspectives that clash with or complement each other. The key is equal status, no hierarchy. Not "a senior checks a junior" but "two colleagues with different priorities." 2. First prompt, the doer role: give the model a role and the task itself. Get a complete answer. 3. Second prompt, the equal-partner role: switch roles. Paste the answer from step 2 right into the prompt. Don't just ask it to "find mistakes"; give it specific questions for the critique, that matters. Add a shared goal: "We both want the best result." 4. Synthesis (optional): ask it to merge the strengths of both answers into a final version.

Examples

[BAD]: `Write an ad campaign concept for a meditation app` [GOOD]: Prompt 1: `You are a creative director with experience in wellness marketing. Your style is emotional and evocative. Come up with an ad campaign concept for a meditation app. Target audience: busy people aged 30-45 with high stress levels. Needed: a slogan, an idea for the hero video, three post ideas.` After getting the answer, Prompt 2: `You are a marketer with the same experience but a different approach: you think in data and look for concrete user value. Your colleague has proposed a campaign concept (below). Your shared goal is to make the campaign as strong as possible. Check: how clear is the slogan without context? Is the video too abstract, does it show a specific problem and its solution? What facts or numbers would strengthen the posts? Suggest 2-3 specific improvements. [Paste the answer from prompt 1]`

In plain words

The point of the study: several AI models solve hard problems much better when they don't just nod along with each other but critique and build on each other's ideas. When one model plays the "generator" and the other the "reviewer," they stop repeating the same mistakes. This works at the level of reasoning structure: LLMs tend to agree with the first plausible-looking option, but if you make them call out the screwups in someone else's answer, accuracy on math and logic shoots up.

It's like renovating your place alone: your eyes glaze over and you don't notice the outlet is crooked. But bring in a perfectionist friend who will point at every flaw, and the result is an order of magnitude better. The study calls this peer-to-peer collaboration: the models talk as equals, argue and double-check each other instead of just pouring a stream of consciousness into the void.

The paper identifies specific strategies: structured critique (the model hunts for weak spots), iterative refinement (gradually polishing an idea) and opinion aggregation. The numbers show that a pair of average models that actively talk to each other can outperform one "smart" but lonely model. The key method here is dynamic dialogue, where each new turn builds on an analysis of earlier mistakes instead of just restating the task.

It was tested on math problems, but the principle is universal. It works for marketing, programming or writing. Instead of asking one model to "make it good," make two models play ping-pong with ideas. One sketches out the creative, the second hunts for weak spots, the first fixes them, and so on until the result is perfect. A single prompt is a lottery; agent collaboration is a system.

Bottom line: if you want to get the most out of AI, stop treating it like a calculator. Build chains of different roles where one model checks another. That turns the process from "hope it doesn't glitch" into a controlled intellectual assembly line. Whoever learns to pit models against each other in search of the truth will get results that are out of reach for regular users with their "write me a post".

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on Role duet: the "peer checks peer" setup is more accurate than a single agent or a hierarchical pair arXiv:2507.17753

Sign in to apply this study New accounts get 50 free credits.

Get the week’s best papers by email

One email on Sundays with the highest-rated new techniques. Unsubscribe with one click.