Apply to my task
arXiv:2507.05984 ★ 74 Jul 8, 2025

The phased protocol: three prompt sections instead of a thousand follow-ups

Key result

If an LLM answers a complex request with generic filler, it's not because the model is bad. It's because you gave it too little data and didn't let it ask questions. The phased protocol gathers the information you need through conversation: the LLM asks follow-ups on its own until the picture is clear. The key rule, "if something is unclear, ask a clarifying question," is baked right into the instructions. The model stops guessing and starts interviewing, and according to the study, users trust that result significantly more than an answer produced without a conversation.

Development and Evaluation of HopeBot: anLLM-based chatbot for structured and interactive PHQ-9 depression screening

Key Aspects of the Research:

The researchers built HopeBot, a GPT-4o-based chatbot that administers a standardized depression screening questionnaire (PHQ-9). Instead of just reading the questions aloud, the bot held a conversation, could ask follow-up questions when it got ambiguous answers, and kept an empathetic tone, drawing on information from a knowledge base (RAG). The experiment showed that users trusted the results from the conversation with the bot significantly more than the results they got from filling out the same questionnaire on their own.

Key Result: An interactive, empathetic conversation structure that can clarify information makes an LLM agent a more reliable and preferred tool for users compared with filling out a static form.


The Core of the Method, Explained:

The method described in the study is a shift from the "request-response" model to a "guided conversation" model. Instead of trying to write one perfect, exhaustive prompt, the user sets up a multi-step process where the LLM actively helps gather and clarify information.

For the user, the practical technique boils down to three core principles:

  1. A phased prompt structure: A complex task is broken into logical stages right inside the LLM's instructions. The study uses this model:

    • Phase 1: Rapport Building. Open with a friendly introduction and ask general warm-up questions.
    • Phase 2: Core Task. Work through the key steps of the task in order.
    • Phase 3: Feedback. A structured wrap-up, summary, and recommendations.
  2. A built-in Clarification Loop: This is the heart of the method. The prompt includes a direct instruction for the LLM: if the user's answer is unclear, ambiguous, or incomplete, the model must ask a follow-up question rather than guess or interpret on its own. This sharply reduces the risk of "hallucinations" and wrong conclusions.

  3. Contextual enrichment (User-level RAG): HopeBot used RAG to answer based on vetted sources. An everyday user can simulate this by providing relevant context in the prompt (for example, an article's text, a product description, a previous email thread) and instructing the LLM to base its answers only on that information.


Practical Applicability Analysis:

  • Direct applicability: Users can start structuring their prompts around the phased model right away. The simplest, most powerful thing you can do is add this instruction to any complex prompt: "If any part of my request is unclear to you, ask me clarifying questions before generating an answer". That directly implements the study's main finding.

  • Conceptual value: The study helps you see that to get a high-quality result, you need to "help" the model rather than expect a miracle. It shows that an LLM does better as an assistant-interviewer than as an all-knowing oracle. The key concept: the quality of the final output depends directly on the quality of the data gathered during the conversation.

  • Adaptation potential: The method is universal. Instead of depression screening, you can adapt it to any task that requires gathering information from the user:

    • Trip planning: Phase 1 (Greeting) -> Phase 2 (Pinning down budget, dates, and vacation preferences through follow-up questions) -> Phase 3 (A finished itinerary).
    • Writing a resume: Phase 1 (Explaining the goal) -> Phase 2 (Gathering information on work experience, skills, and education through a series of questions) -> Phase 3 (A finished resume in several versions).
    • Product-buying advice: Phase 1 (Greeting) -> Phase 2 (Figuring out needs, budget, and use cases) -> Phase 3 (A shortlist of the top 3 models with explanations).

Practical Example:

You are an experienced marketing strategist who specializes in helping small businesses. Your job is to help me develop a content plan for my project. Keep the conversation friendly and supportive.

Follow this three-phase protocol strictly:

**Phase 1: Getting to know the project.**
Start with a greeting. Then ask me a few key questions to understand the essence of my business. For example: "Tell me about your product or service," "Who is your target audience?", "What are your main goals (increase sales, build awareness, etc.)?" Wait for my answers.

**Phase 2: Gathering and clarifying information (the most important stage).**
Once I've answered the Phase 1 questions, we'll move on to the details. Your task is to suggest content ideas.

**[KEY CLARIFICATION RULE]:** If during our discussion my answers are general or vague (for example, if I say "I want social media posts" or "we need something about our advantages"), you **MUST** ask clarifying questions to get specifics.
Examples of clarifying questions:
- "Great, social media posts. Which platform should we focus on first: Instagram, TikTok, or LinkedIn?"
- "When you talk about advantages, what's the one most important advantage we should get across to customers first?"
- "Which content format do you think will appeal most to your audience: short videos, articles, infographics?"

Keep asking questions until you have enough information to build a detailed plan.

**Phase 3: Building the content plan.**
Once you've gathered all the information you need, pull it together and present it as a structured one-week content plan in table format. The table should have the columns: "Day of the week," "Post topic," "Format," "Key idea/talking points."

Let's begin. I'm ready to answer your questions.

Why It Works:

This prompt works because it faithfully reproduces the successful model from the HopeBot study, transplanting it from healthcare into marketing:

  1. A structured conversation: The prompt doesn't require the user to hand over all the information at once. It sets a clear three-phase structure that guides the LLM and makes the interaction predictable and logical.
  2. Active clarification: The [KEY CLARIFICATION RULE] construction is a direct implementation of the study's main finding. It forces the LLM to ask again instead of filling in the blanks. That prevents useless, generic content (like "write interesting posts") and leads to a personalized, relevant plan.
  3. More trust and engagement: Just as in the study, the user feels "heard." Clarifying questions create the impression of working with a thoughtful specialist rather than a machine. That increases trust in the final result and engagement in the process.

Another Practical Example

You are a personal event-planning assistant. Your job is to help me organize a birthday celebration. Your communication style is caring, detail-oriented, and highly organized.

We'll work step by step, in three phases.

**Phase 1: Setting the overall frame.**
Start with a friendly greeting. Then ask me 3-4 main questions to understand the big picture of the party. For example: "Who are we throwing the birthday for, and how old are they turning?", "What's the approximate date and budget?", "How many guests are you planning to invite?"

**Phase 2: Detailing and clarifying.**
After my answers, we'll dig into the details. Your goal is to gather all the information needed to put together a plan.

**[INTERACTIVITY RULE]:** If my answers are incomplete or leave you too much room for imagination (for example, if I say "the food should be tasty" or "entertainment for everyone"), you **MUST** ask clarifying questions to narrow down the options.
Examples of clarifying questions:
- "What cuisine does the birthday person prefer: Italian, Asian, maybe home-style comfort food?"
- "When you say 'entertainment for everyone,' will there be both kids and adults? Should we plan a separate program for the kids?"
- "Which vibe feels more like you: a loud party with dancing or a cozy evening with close friends and family?"

Your job at this stage is to be my brainstorming partner, suggest options, and pin down my preferences.

**Phase 3: Putting together the final plan.**
Once you've gathered all the details, give me a final birthday prep checklist. It should be broken into categories: "Venue," "Menu," "Entertainment," "Decor," "To-do list for the week before the party."

OK, I'm ready to start planning. Ask your first questions.

Why This Example Works: The Mechanism.

This prompt is effective because it applies the same psychologically and technically sound logic as HopeBot to an everyday task:

  1. Lower cognitive load: Instead of the user trying to keep every aspect of the planning in their head, the prompt delegates that job to the LLM. The phased structure turns a chaotic process into an orderly sequence of steps.
  2. Preventing irrelevant suggestions: The [INTERACTIVITY RULE] construction is the key. Without it, a request to "organize a birthday party" could get a cookie-cutter plan that doesn't suit the user at all. Clarifying questions ensure the final plan is based on real preferences, budget, and guest list.
  3. Simulating an expert approach: The process set in the prompt mimics how a professional event planner works: first gather general requirements, then drill into the details, and only then draw up the plan. This not only improves the result but, as the study showed, builds the user's trust and satisfaction with the interaction.

Usefulness Score: 92

02

Main Evaluation Criteria

  • A. Relevance to prompting techniques: Yes, the study reveals the value of structured conversation, the clarifying-question technique, and using RAG to improve answer quality.
  • B. Better conversational answers: Yes, this is the central theme. The interactive approach is shown to raise trust (71% of users), comfort (8.4/10), and perceived support.
  • C. Direct practical applicability: Yes, the principles of structuring a conversation (getting-acquainted phase, core task, wrap-up) and the "ask for clarification" mechanic can be applied by users in their own prompts immediately, with no code at all.
  • D. Conceptual value: Very high. The study vividly demonstrates that an LLM isn't just a "black box" that spits out answers but a tool you can, and should, steer through conversation. It explains why interactivity and clarification build trust and improve accuracy.
  • E. A new useful practice: The work falls into several clusters at once:
    • 1. Prompt phrasing techniques: Describes a methodology for structured conversation and clarifying requests.
    • 2. LLM behavioral patterns: Shows that an LLM allowed to ask clarifying questions is perceived as more reliable.
    • 6. Context and memory: Uses RAG, whose core idea (providing relevant information in the prompt) everyday users can apply too.
    • 7. Reliability and stability: The clarification mechanism directly improves the reliability and accuracy of extracting information from user answers.
  • Practicality checklist: Provides clear takeaways you can factor into prompt design right away (for example, "add a phase for clarifying unclear answers to the conversation"). The score should be at least 75 points. Applying the 15 bonus points is justified.
03

Numerical Usefulness Score

Arguments for a high score (92): The study provides not just a "trick" but an entire methodology for building complex, multi-stage conversations with LLMs. The key takeaway: interactivity and clarifying unclear information matter more than simply phrasing the initial question correctly. That's a fundamental shift in how we think about prompting, from "monologue" to "dialogue." Users at any level can start applying this approach immediately by adding instructions like: "Before giving a final answer, ask me clarifying questions if my requirements seem incomplete or ambiguous." This directly improves the quality and relevance of answers on complex tasks.

Counterarguments (why the score could be lower/higher): * Why it could be lower: The focus on a highly specialized medical topic (depression screening) may put off everyday users. Applying the findings takes some mental effort to adapt the method to your own tasks (for example, from vacation planning to drafting a business plan). It's not a ready-made copy-paste recipe. * Why it could be higher: This is one of the few studies that empirically proves the value of empathy, structure, and clarification loops in a conversation with an LLM, offering a universal framework. The RAG (Retrieval-Augmented Generation) concept is explained through a practical example, which helps users understand the benefit of giving the model external context, one of the most powerful prompting techniques there is.


Research digest

Key result

If an LLM answers a complex request with generic filler, it's not because the model is bad. It's because you gave it too little data and didn't let it ask questions. The phased protocol gathers the information you need through conversation: the LLM asks follow-ups on its own until the picture is clear. The key rule, "if something is unclear, ask a clarifying question," is baked right into the instructions. The model stops guessing and starts interviewing, and according to the study, users trust that result significantly more than an answer produced without a conversation.

Principle

A standard prompt is a monologue. You talk, the model answers. It doesn't know what it doesn't know, so it confidently fills the gaps with made-up details. The phased protocol breaks that pattern. Three steps, right in the instructions: Phase 1, build rapport and ask general questions. Phase 2, gather details through follow-ups. Phase 3, only now deliver the final result in the required format. The crucial part is an explicit ban on guessing: "if an answer is vague or incomplete, ask before moving on." Without that ban, the model will silently decide for you what you meant by "make something interesting."

Why it works

The quality of the output is determined by the quality of the input. LLMs aren't telepathic; they work with what they're given. Fuzzy data in, fuzzy output out. The clarification loop isn't politeness or a UX gimmick. It's a data-gathering mechanism that runs before generation and cuts hallucinations off at the root. The study tested this on the PHQ-9 medical questionnaire for depression screening, arguably one of the most sensitive scenarios there is. The result: users who went through the conversational version trusted the outcome noticeably more than those who filled out the same questionnaire by hand. That tells us something important: it's not just about accuracy; it's also about the person feeling heard.

When to apply

Any task where the LLM doesn't have all the information it needs up front. Planning: itineraries, events, budgets. Document creation: resumes, content plans, sales proposals. Consultations: product recommendations, sorting through a situation, diagnostics. Especially useful when the user doesn't fully know what they want yet; clarifying questions help them figure it out. NOT suited to simple tasks where all the information is already in the request; there, phases only slow things down.

Mini recipe

1. Set the role and tone: Say who the model is, how it communicates, and in what manner. This sets the tone for the whole conversation. 2. Split the task into three phases right in the prompt text: Phase 1, greeting and general questions. Phase 2, gathering details. Phase 3, the final result in a specific format. 3. Bake the clarification rule into Phase 2 in bold: Write it literally: MANDATORY RULE: if my answer is vague or incomplete, ask a clarifying question before moving on. Without this explicit ban, the model will silently guess. 4. Lock in the final output format ahead of time: A table, a bulleted list, a checklist; name it specifically. Otherwise you'll get a wall of text.

Examples

[BAD]: `Make an Instagram content plan for my coffee shop` [GOOD]: `You're a marketer for small businesses. You communicate in a friendly way, without unnecessary words. Phase 1: Say hello and ask 3 questions: what kind of place it is, who the customers are, what the main goal is (sales / awareness / foot traffic). Wait for my answers. Phase 2: Clarify the details for the content. [MANDATORY RULE]: if my answer is general, for example "I want posts about coffee," ask a clarifying question: "which angle exactly: where the beans come from, what the baristas do, or promotions?" Keep clarifying until you have specifics. Phase 3: Build a 7-day content plan in a table with the columns: Day / Topic / Format / Main idea of the post. Start with Phase 1.`

In plain words

The point of HopeBot is that it turns a dreary questionnaire into a real conversation, where the AI doesn't just pelt you with questions but mimics empathetic listening. Instead of dumping the standard nine-item PHQ-9 questionnaire on a person, the model uses structured interaction. It analyzes the answer, offers a short supportive reply, and only then moves on to the next item. That breaks down the "robot vs. human" barrier, because the machine starts acting like an attentive therapist rather than a bureaucrat with a clipboard.

It's as if you went to the doctor and, instead of silently burying his nose in your chart and ticking boxes, he nodded thoughtfully at every complaint and said: "Yes, I understand, that really is hard." In that situation you can't help relaxing, and you share far more details than if someone had just shoved a form at you with answers ranging from "never" to "nearly every day." Technically the outcome is the same, but trust and data accuracy in the conversation go through the roof.

The system rests on three pillars: dynamic adaptation, answer validation, and empathetic acknowledgment. The HopeBot method doesn't just record dry facts; it checks how well an answer maps onto the depression scale, and if the person dodges or answers vaguely, the AI gently asks for details. The study showed this combination delivers high correlation with clinical diagnoses, while users don't feel interrogated. The model literally "draws out" the information it needs from the patient through a human interface of conversation.

Although it was tested on depression diagnosis, the principle is universal for any data collection. You can bring the same mechanics into sales, tech support, or HR interviews: anywhere you need an honest, detailed answer from a person rather than a perfunctory brush-off. Replace a dry questionnaire with an interactive, supportive script, and the rate at which people open up grows exponentially. Surveys are dying, conversational interfaces are winning, because people want to be heard, not just categorized.

Bottom line: stop torturing people with static forms that only make them want to close the tab. The future belongs to structured empathy, where the AI leads the user down a set path but does it so gently they never notice the rigid algorithm under the hood. HopeBot proved that empathy is a feature, not a bug, and it makes data more accurate. Whoever first swaps their "feedback forms" for conversations like this will get the cleanest analytics around, while everyone else keeps wondering why everybody lies to them.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on The phased protocol: three prompt sections instead of a thousand follow-ups arXiv:2507.05984

Sign in to apply this study New accounts get 50 free credits.

Get the week’s best papers by email

One email on Sundays with the highest-rated new techniques. Unsubscribe with one click.