Apply to my task
arXiv:2507.07870 ★ 75 Jul 10, 2025

A three-stage dialogue: separate the roles, get precise answers

Key result

LLMs struggle when they have to gather information and draw conclusions at the same time. It's like asking a detective to name the killer before examining the crime scene: the model 'takes a shortcut' and produces a generic template answer instead of a precise one. DocCHA lets you steer the model's focus through a strict separation of roles at every step of the dialogue. The trick: three separate prompts with prohibitions: interviewer, investigator, analyst. The model can't 'run ahead' and deliver a conclusion until it has collected the full data set. The result: personalized answers, not template ones.

DocCHA: TowardsLLM-Augmented Interactive Online diagnosis System

Key Aspects of the Study:

The study presents DocCHA, a system that imitates the process of medical diagnosis. Instead of trying to reach a diagnosis in one shot, the system splits the dialogue into three logical stages: collecting symptoms, taking the medical history and building a cause-and-effect chain. This structured approach lets the LLM ask more precise questions and get far more reliable and accurate results than standard direct prompts.

Key Result: Decomposing a complex task into sequential, manageable stages of information gathering followed by analysis dramatically improves the quality and reliability of LLM answers.


The Core of the Method, Explained:

For practical use in prompts, the essence of the method is dropping the "one-shot" approach ("do everything at once in one prompt") in favor of a guided multi-stage dialogue. The user acts as the "director", walking the LLM through a sequence of logical stages, just like the DocCHA system does.

Here's the routine:

  1. Stage 1: Fact Gathering (the analog of "Symptom Collection"). You give the LLM the role of an "interviewer" or "data collector". Your first instruction strictly limits its job: only ask questions to gather key information. You forbid the model from drawing conclusions or making recommendations at this stage.

    • Goal: get a complete set of input data without letting the LLM "take a shortcut" and hand you a premature solution.
  2. Stage 2: Context Gathering (the analog of "History Acquisition"). Once the core facts are collected, you give the second instruction. Now the LLM's job is to ask follow-up questions about context, history, constraints or hidden factors that could affect the final decision.

    • Goal: enrich the input data with important context the model might have missed.
  3. Stage 3: Synthesis and Reasoning (the analog of "Causal Graph Construction"). Only when you (the user) decide there's enough information do you give the final instruction. Now the LLM's role switches to "expert" or "analyst". You ask it to use all the information gathered in the previous steps to build a logical chain of reasoning and deliver a final, structured answer.

    • Goal: make the model use complete, verified information to reach its final decision, which improves quality and reduces the risk of hallucinations.

In essence, you're not writing one complex prompt; you're creating an interaction script in which each next step follows logically from the previous one, and at every stage the LLM has a clearly defined, understandable role.


Practical Applicability Analysis:

  • Direct applicability: The user can take this three-stage logic as is and apply it to any complex task (trip planning, business strategy, writing a complex article). Instead of one prompt, they send three in sequence, changing the LLM's role and task each time according to the method.
  • Conceptual value: The key idea: an LLM works better when its attention is artificially narrowed to a specific subtask. The study teaches the user not to "trust" the model with the whole task at once but to "steer" its thinking process by breaking it into clear steps. That fundamentally shifts prompting from "asking" to "managing a process".
  • Adaptation potential: The method adapts easily. Instead of three stages there can be two or four, depending on the task. For example, for writing an essay: 1) Brainstorm and collect ideas (fact gathering), 2) Build the structure and outline (context/structure gathering), 3) Write the text from the outline (synthesis). The user simply adapts the names and goals of the stages to their task.

Practical Example:

Task: Plan a complicated family vacation with lots of conflicting requirements.

You are "Voyage Architect", an elite travel consultant. Your task is to help me plan the perfect vacation. We will work in 3 stages. **Do not move on to the next stage until I tell you to.**

---

### **STAGE 1: GATHERING KEY FACTS**

Your only goal at this stage is to collect basic information. Ask me questions one at a time until you have answers to all the points below. **At this stage, do not suggest any countries or hotels!** Just collect data.

**Fact-gathering questions:**
1.  What is the total trip budget (including flights, lodging, activities)?
2.  What are the exact or approximate travel dates? How long is the trip?
3.  Who is going? (group makeup: adults, kids, their ages).
4.  Which countries or regions are you **absolutely not considering**?
5.  What main type of vacation are you interested in (beach, active, sightseeing, food-focused, etc.)?

Begin. Ask the first question.

(After the user has answered all the questions, they write: "Great, we've finished Stage 1. Moving on to Stage 2.")

### **STAGE 2: CLARIFYING PREFERENCES AND CONTEXT**

Now, based on the facts collected, your task is to understand our deeper preferences. Ask follow-up questions to understand the "vibe" of the ideal vacation. **Still do not suggest specific options!**

**Sample follow-up questions:**
*   How important is fast, reliable internet?
*   What pace do you prefer: relaxed or packed with activities?
*   Are there any special dietary requirements or food preferences?
*   How important is nightlife?
*   What is the minimum acceptable level of lodging comfort (5-star hotel, cozy apartment, villa)?

Start asking follow-up questions.

(After answering, the user writes: "That's enough information. Moving on to the final Stage 3.")

### **STAGE 3: SYNTHESIS AND FINAL PROPOSAL**

Now you are an expert analyst. Using **all the information** gathered in Stages 1 and 2, create 3 detailed vacation proposals.

**Structure of each proposal:**
1.  **Name and concept:** (e.g., "Relaxed luxury on the Amalfi Coast").
2.  **Country and resort:** Why they are a perfect match for our request.
3.  **Sample day-by-day plan:** Key activities.
4.  **Estimated budget breakdown:** Flights, lodging, other.
5.  **Rationale:** Briefly explain exactly how this option matches our answers from Stages 1 and 2.

Why It Works:

This prompt works through forced decomposition and control over the LLM's focus of attention:

  1. Preventing premature conclusions: In Stage 1 the model can't jump straight to suggesting "a trip to Cancun" because it's explicitly forbidden to. It has to gather all the constraints first (budget, dates, group makeup), which rules out 90% of unsuitable options.
  2. Complete data: Splitting fact gathering from context gathering ensures that not only formal requirements (budget) but also informal ones ("vibe") are taken into account. Without this, the model often ignores the latter.
  3. High-quality synthesis: In Stage 3 the model works not from general knowledge but from a complete, structured and verified data set about a specific user. That forces it to generate deeply personalized, well-reasoned proposals instead of template ones.

Another Practical Example

Task: Develop a content strategy for a new healthy-eating blog.

You are an experienced content strategist. We will build a content plan for my new blog in 3 stages. **Do not mix the stages, and wait for my command before moving on to the next one.**

---

### **STAGE 1: ANALYZING GOALS AND AUDIENCE**

Your task is to understand the project's foundation. Ask me questions to find out the following. **Do not suggest article topics at this stage!**

**Analysis questions:**
1.  Who is my target audience (e.g., new moms, athletes, people with digestive issues)?
2.  What is the blog's main goal (selling courses, building awareness, monetizing through ads)?
3.  What makes my approach unique compared to thousands of other nutrition blogs?
4.  What Tone of Voice do we want to use (popular science, friendly, strict expert)?

Ask the first question.

(After answering, the user writes: "Strategy data collected. Moving on to Stage 2.")

### **STAGE 2: DEFINING CONTENT PILLARS AND FORMATS**

Based on the goals and audience from Stage 1, propose 3-5 key content pillars (thematic pillars) for the blog. For each pillar, suggest 2-3 possible content formats (e.g., "Recipes", "Myth busting", "Expert interview", "Research roundups").

**Your task is only to define the structure, not specific topics.**

(After discussing and approving the pillars, the user writes: "Structure approved. Moving on to Stage 3.")

### **STAGE 3: GENERATING THE ACTUAL CONTENT PLAN**

Great. Now, using the approved goals, audience, pillars and formats, create a content plan for the first 2 weeks (6 posts).

**Present the result as a table with these columns:**
| Publish day | Pillar | Format | Working article title | Short description (2-3 sentences) |
|-------------|--------|--------|-----------------------|-----------------------------------|

Create the table.

Why This Example Works: The Mechanism.

The mechanism of success here is the same: strategy before tactics.

  1. A foundational approach: The prompt makes the LLM think first as a strategist (Stage 1: "WHY and FOR WHOM are we doing this?"), then as an architect (Stage 2: "HOW do we structure it?"), and only then as a copywriter (Stage 3: "WHAT exactly are we writing?").
  2. Avoiding clichés: Without this structure, a request to "come up with a content plan" gets you banal topics like "10 healthy breakfast foods". After going through Stages 1 and 2, the model generates titles precisely aimed at a specific audience (e.g., "Hypoallergenic breakfasts for kids under 3" if the audience is new moms) and aligned with the blog's goals.
  3. Guided creativity: The structure doesn't kill creativity; it channels it in the right direction. The model has to be creative within the given constraints, which leads to far more relevant and valuable ideas.

Usefulness Score: 82

02

Main Evaluation Criteria

  • A. Relevance to prompting techniques: High. Although the study describes a system (a framework), its core is a structured, multi-stage dialogue driven by prompts. The appendix provides concrete sample prompts that illustrate the logic.
  • B. Better conversational answers: Very high. The whole point of the study is to show how the proposed approach dramatically improves the accuracy and completeness of answers compared with standard prompts.
  • C. Direct practical applicability: Medium. A user can't reproduce the "DocCHA" system with its internal "confidence score" calculations. But they can fully imitate its logic by manually steering the dialogue stages with a series of prompts. It takes some thought, but it gives you a powerful tool.
  • D. Conceptual value: Very high. The study offers a brilliant mental model for solving complex tasks: decomposition. It clearly shows why trying to solve a complex problem with one prompt is less effective than a guided, step-by-step process of gathering information and then synthesizing it.
  • E. New useful practice (clusters): The paper falls into several key clusters at once:
    • 1. Prompt formulation techniques: Offers an advanced technique for decomposing a task into sequential prompts.
    • 3. Prompt structure optimization: Shows the value of a modular interaction structure.
    • 5. Extraction and structuring: The system's first two modules are entirely about efficient information extraction.
    • 7. Reliability and stability: The third module (building a causal graph) directly targets fewer hallucinations and better logical coherence of the answer.
  • Practicality checklist (+15 points): Yes, the study provides ready-made prompt constructions (in the appendix), shows how to structure complex requests and offers ways to improve accuracy.
03

Numerical Usefulness Score

The score of 82 reflects the huge conceptual value and the concrete sample prompts that can be adapted. It's not a "100-point ready-made recipe" you can copy and paste, but it's a fundamental principle, and mastering it takes your prompting skills to a new level.

Arguments for a higher score: * The decomposition principle at the heart of DocCHA is one of the most powerful methods in advanced prompt engineering. For an experienced user looking for ways to tackle non-trivial tasks, this study is a gold mine of ideas. * The study clearly demonstrates that "naive" prompting is ineffective for complex tasks and offers a clear, working alternative.

Counterarguments (for a lower score): * Direct application is harder. The user has to "orchestrate" the dialogue manually, playing the role of the DocCHA system, which takes more effort than writing a single prompt. * The specialized domain (medicine) and the use of external databases (UMLS) may give users the impression that the method doesn't apply to everyday tasks, even though it does.


Research digest

Key result

LLMs struggle when they have to gather information and draw conclusions at the same time. It's like asking a detective to name the killer before examining the crime scene: the model 'takes a shortcut' and produces a generic template answer instead of a precise one. DocCHA lets you steer the model's focus through a strict separation of roles at every step of the dialogue. The trick: three separate prompts with prohibitions: interviewer, investigator, analyst. The model can't 'run ahead' and deliver a conclusion until it has collected the full data set. The result: personalized answers, not template ones.

Principle

Not one big prompt, but three small ones with different restrictions. At the first stage the LLM is forbidden to draw conclusions. At the second, to make recommendations. At the third, it's finally allowed to synthesize. The model works like an assembly line, not an oracle: each stage has one job and one prohibition: don't jump ahead. You, as the director, decide when to move to the next step. The model doesn't move on by itself.

Why it works

An LLM has a limited 'attention budget' for a task. When there's one goal (collect the facts), the model asks precise questions and doesn't get lost. When it has to both gather and analyze, it jumps between modes and gives generic answers. A prohibition ('don't suggest options at this stage') isn't a restriction, it's focus: the model has to work through the current subtask in depth. At the final stage the model operates on a full set of concrete data about your situation instead of filling the gaps from general knowledge. It's the difference between 'recommend a beach hotel' and 'recommend a hotel knowing that two kids aged 3 and 7 are coming, the budget is $5,000, we need Wi-Fi, and the beach should be quiet'.

When to apply

Any task with lots of variables and conflicting requirements. Trip planning -> especially when there are many constraints (kids, budget, dates). Content development -> especially when you need a strategy, not a list of topics. Business analysis -> especially when you're evaluating an idea or looking for the root cause of a problem. NOT a fit for simple, clear-cut requests; there a three-stage dialogue only slows things down.

Mini recipe

1. Define three stages for your task: fact gathering -> context clarification -> synthesis. Examples: for writing an article, topic and audience -> structure and tone -> text. For a business strategy, goals and resources -> constraints and risks -> plan. 2. Write prohibitions for each stage: for the first, `Don't propose solutions. Only ask questions, one at a time`. For the second, `Only follow-up questions. No recommendations`. For the third, `Use ALL the information from the previous stages`. 3. Keep control yourself: add the phrase `Don't move on to the next stage without my command` to every prompt. You decide when there's enough data. This is the key part; otherwise the model will start hopping between stages on its own. 4. Switch the role at the end: in the third prompt, state explicitly that the role changes: `Now you are an expert analyst. Use everything we discussed in stages 1 and 2`. This switches the model from 'gathering' mode to 'conclusion' mode.

Examples

[BAD]: `Help me plan a 2-week family vacation with a $5,000 budget` [GOOD]: `You are a travel consultant. We work in 3 stages; don't move on to the next one without my command. Stage 1: ask me questions one at a time: budget, exact dates, group makeup with ages, which countries or vacation types we're ruling out. At this stage, don't suggest any destinations or hotels. Start with the first question.` Once you've answered all the questions, you write: `Stage 1 is done. Moving on to Stage 2.` Next: `Stage 2: based on what you've gathered, ask follow-up questions about the vibe of the vacation: pace, how important internet is, food, lodging level. Still no specific suggestions.` After answering: `Stage 3: you are an expert analyst. Use EVERYTHING from stages 1 and 2. Propose 3 vacation options with a rationale for why each one fits our answers specifically.`

In plain words

The gist of DocCHA: on complex tasks, ordinary models behave like hyperactive interns, grabbing everything at once and ending up with a mess. The system breaks that habit by making the model work through interactive diagnosis. Instead of dumping a ready-made (and most likely lopsided) plan on you, the AI first grills you, pulling out hidden context and contradictions you hadn't considered yourself. It's a fundamental shift from "ask and get an answer" to a full cognitive loop, where the model doesn't guess, it clarifies.

It's like going to an experienced doctor and saying, "My side hurts, just prescribe me a pill." A bad doctor (plain ChatGPT) writes a prescription right away based on statistics. A good doctor is DocCHA: no prescription until it runs a series of tests and asks what you ate yesterday and whether you're allergic to citrus. Technically you came for an answer, but without the right questions that answer is total junk. The system turns the model's monologue into a meaningful interview, where every clarification cuts off unnecessary options.

Under the hood there are two key mechanisms: forced decomposition and focus control. The model doesn't try to digest your whole vacation chaos in one bite; it breaks it into atoms: logistics, budget, the kids' whims, dates. First it locks in one variable, then strings the rest onto it. If the requirements start to clash (we want mountains, but also the beach, and cheap), the system doesn't "hallucinate" a compromise; it explicitly highlights the conflict and makes you pick a priority.

Although the name says "diagnosis", the principle is universal. It was tested on planning and medicine, but it fits any complex task perfectly, from writing code to building a marketing strategy. Wherever there are lots of inputs and a risk of error, DocCHA works as a safety fuse. It's a shift from looking up information to designing solutions, where the AI isn't just a reference book but the architect of the process, keeping you from getting tangled up in your own wish list.

Bottom line: it's time to admit that giant wall-of-text prompts are a dead end, because the model gets lost in them. The future belongs to iterative clarification, where the AI leads you by the hand through the maze of conditions. The big payoff is that you end up not with a "hallucination loosely based on your request" but with a verified plan that accounts for every little thing. Those who keep using AI like a search engine will keep getting garbage; those who switch to the diagnosis format will get expert-level results.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on A three-stage dialogue: separate the roles, get precise answers arXiv:2507.07870

Sign in to apply this study New accounts get 50 free credits.

Get the week’s best papers by email

One email on Sundays with the highest-rated new techniques. Unsubscribe with one click.