Apply to my task
arXiv:2507.16075 ★ 92 Jul 21, 2025

TTD-DR: Iteratively Refine a Draft Instead of Chasing the Perfect First-Try Prompt

Key result

The longer and more complex the document, the worse one big prompt works. The model tries to cover everything at once and starts making things up. The TTD-DR method (Test-Time Diffusion Deep Researcher) lets you build accurate, detailed reports iteratively, with no fine-tuning and no special tools. The key: start with a deliberately incomplete draft, not a request for the final text. The draft reveals the holes. You fill the holes with real data. The model stitches the data back in, and the draft gets more accurate. Three or four rounds like this turn a sketch into a polished document.

Deep Researcher with Test-Time Diffusion

Key Aspects of the Study:

The study proposes a new way to produce complex, long-form texts (reports, for example) with an LLM by imitating how a human works. Instead of generating the whole thing in one go, the method first writes a rough draft, then iteratively "cleans up" and fills it in, querying search engines for missing information at every step. This "draft -> search -> refine" loop produces reports that are more accurate, more complete and more logically coherent.

Key Result: Iteratively refining a draft while continuously pulling in outside information significantly beats standard single-pass text generation.


The Core of the Method, Explained:

The method, which the authors call Test-Time Diffusion Deep Researcher (TTD-DR), is easiest to explain through a simple analogy with how a writer or researcher works.

Imagine you have to write a detailed report on a hard topic. You are unlikely to nail it perfectly from the first word to the last in one sitting. More likely, your process looks like this: 1. Sketch (Outline): First you build a structure, a table of contents or a very rough draft based on what you already know. 2. Spotting the "blank spots": Rereading the draft, you see where facts, data or arguments are missing. 3. Finding information: You go online or to the library and look for exactly the information that fills those "blank spots". 4. Refining and editing: You come back to the draft, work in the new data, fix inaccuracies and tighten the wording. 5. Repeating: You repeat steps 2-4 until the report is complete and solid.

TTD-DR makes the LLM work exactly the same way. For a regular user, this means moving from one giant prompt to a series of prompts that walk the LLM through the loop:

  • Step 1: Create a "noisy" draft. You ask the LLM to produce an initial, possibly incomplete and shallow answer to your hard question using only its "internal knowledge".
  • Step 2: Identify the gaps and generate search queries. You (or the LLM, at your request) analyze the draft and figure out what information is missing. Then you ask the LLM to write precise search queries to find that data.
  • Step 3: "Denoising" (cleanup) with outside information. You hand the LLM what you found (for example, by pasting text from articles) and give the command: "Update and expand the draft using this new information".

The process repeats several times. With every pass the draft gets better and more accurate, turning from a "noisy" sketch into a clean, well-developed document.


Practical Applicability:

  • Direct applicability: A user can simulate this process directly in any advanced chatbot (ChatGPT, Claude, Gemini). No code or special tools required. The user plays "project manager" and the LLM plays the "intern" who has to be steered through rounds of edits. A hard task stops being one gigantic prompt and becomes a manageable series of steps.

  • Conceptual value: The main takeaway for users: don't demand perfection from an LLM in a single step on complex tasks. Use the LLM as a partner in an iterative process instead. Treating the "draft" as a mutable centerpiece that drives the next actions is a powerful mindset shift. It shows that an LLM's strength lies not only in generating, but also in analyzing, planning and reflecting on its own work.

  • Adaptation potential: The method is universal. You can adapt it to any task that requires complex, structured content:

    • Writing a business plan.
    • Building a marketing strategy.
    • Planning a detailed trip.
    • Writing a video script.
    • Writing a term paper. The adaptation mechanism is simple: start any big task by asking for a "rough draft", then improve it iteratively, asking the LLM to help find and integrate the missing information.

A Practical Example:

Say a user wants to plan a detailed two-week trip to Italy for a family with kids but has never been there.

Prompt 1: Create the initial plan and draft

# Role: Experienced travel agent specializing in family trips to Italy.

# Task: Create an initial, rough plan for a 14-day trip around Italy for a family with two kids (ages 8 and 12). It's their first trip there.

# Context:
- Budget: mid-range.
- Interests: history, great food, beautiful views, fun things for kids.
- Pace: not too fast, no moving to a new city every day.

# Instructions:
1.  Suggest a route through 3-4 main cities (for example, Rome, Florence, Venice).
2.  For each city, sketch 2-3 key sights or activities that work for a family.
3.  Suggest ways to get between cities.
4.  Structure the answer as a rough day-by-day calendar.

This is a draft; precise details don't matter yet. The point is to build a foundation we'll develop further.

Prompt 2 (after you get the answer): Identify gaps and search

Great draft! Now let's improve it.

Analyze this plan and identify the 5 key questions we need answered to make it concrete and doable. Phrase them as practical questions to search on Google.

Example areas for questions:
- Booking tickets for popular museums (Colosseum, Vatican).
- How public transit works in each city.
- Finding family-friendly restaurants.
- The best ways to buy train tickets.

Prompt 3 (after you get the questions and do the "search"): Refine the draft

I researched your questions and here's what I found:
1.  Tickets for the Colosseum and the Uffizi Gallery need to be booked online 1-2 months ahead, otherwise the lines are huge.
2.  In Venice the most convenient transport is the vaporetto (water bus); a 3-day pass is a good deal.
3.  High-speed Frecciarossa trains run between Rome and Florence; tickets are cheaper if bought in advance on the Trenitalia website.
4.  Florence has a great interactive Leonardo da Vinci museum that kids love.

# New task:
Now please update our initial rough travel plan, working in this new, specific information. Add notes like "[IMPORTANT:]" or "[TIP:]" where appropriate.

Why It Works:

This approach works through decomposition and managed context:

  1. Lower cognitive load: The first prompt doesn't demand a perfect, fully vetted plan right away. It asks for a "draft", which lets the model produce a good structure without getting bogged down in details or starting to hallucinate.
  2. Focused reflection: The second prompt switches the LLM from "generator" mode to "analyst" mode. The model analyzes its own output and looks for weak spots. That forces it to think about the practical side of the plan.
  3. Grounding in facts: The third prompt gives the model external, verified information. Instead of making things up, the LLM gets concrete facts to integrate. The "update the draft" command with new data is exactly the "denoising" process described in the paper. The draft gets more accurate and more useful.

Another Practical Example

Task: Build a one-month content strategy for a new online store selling handmade ceramics.

Prompt 1: Draft the strategy

# Role: Marketer and social media expert for handmade brands.

# Task: Create a draft one-month content plan for the new Instagram account of a handmade ceramics shop.

# Context:
- Product: unique handmade tableware (mugs, plates, vases).
- Target audience: people aged 25-45 who value coziness, aesthetics and one-of-a-kind things for the home.
- Goal: raise brand awareness and attract the first followers.

# Instructions:
1.  Suggest 3-4 main content pillars (for example, "Making Of", "Inspiration", "Ceramics at Home").
2.  Sketch 2-3 post ideas for each pillar.
3.  Suggest an overall 4-week structure.

This is an initial sketch so we have a foundation to work from.

Prompt 2 (after you get the answer): Identify gaps and search

Thanks, that's a good foundation. Now let's think about how to make this strategy more competitive.

Analyze the proposed plan and name 4 aspects we need to research among competitors and adjacent niches in order to stand out. Phrase them as analysis tasks.

For example: "Analyze which content format (Reels, carousels, static photos) works best for 3-5 popular ceramicists on Instagram".

Prompt 3 (after you get the tasks and do the "analysis"): Refine the draft

I did the analysis, and here are the key findings:
1.  Reels showing work on the pottery wheel set to meditative music get 5x the reach of photos.
2.  Competitors rarely show "behind the scenes" (failed pieces, sourcing clay, setting up the studio); this could become our signature.
3.  Collab posts with food bloggers (food served on our tableware) draw a lot of interest.
4.  The audience actively responds to Story polls about choosing the glaze color for a new batch.

# New task:
Rework our draft content plan. Put the emphasis on video content (Reels), add a "Behind the Scenes" pillar and schedule activities based on these findings (collaborations, interactive Stories).

Why This Example Works, Explained.

The mechanism of success here is the same as in the first example, and it fully mirrors the core of the paper:

  1. From general to specific: The first prompt creates a general but logical structure (pillars, ideas). That's the "skeleton" of the future plan.
  2. Strategic analysis: The second prompt makes the LLM do more than generate ideas; it has to think like a strategist: "What do we need to know to win?". That moves the task from "what to post" to "how do we win attention".
  3. Adapting to reality: The third prompt brings "real-world" data (the analysis results) into the abstract plan. The LLM doesn't invent the idea that Reels are popular; it uses that as a given fact. The "refine the draft" process turns a template strategy into a tactically sound plan based on market data. That's the "denoising": stripping out generic, "noisy" ideas and replacing them with concrete, effective actions.

Usefulness Score: 92

02

Main Evaluation Criteria

  • Pre-filter: The study is entirely focused on generating text reports with LLMs and search engines. It passes the filter.
  • A. Relevance to prompting techniques: Yes, it reveals a high-level strategy (meta-prompting): iteratively creating and improving a draft. It's not a specific phrase but an entire workflow that a user can simulate by hand.
  • B. Improving answer quality: Yes, the study directly targets the completeness and usefulness of complex, long answers (research reports), which is a key task for many users.
  • C. Direct practical applicability: High, but it takes effort. A user can't run the TTD-DR framework itself but can easily simulate its logic in a chatbot conversation, acting as the process "coordinator".
  • D. Conceptual value: Very high. The study offers a powerful mental model: instead of demanding a perfect result from the LLM in one shot, work with it iteratively, like with a junior assistant: assign a draft, review it, send it back for revision with new data.
  • E. New useful practice (clusters):
    • Cluster 1 (Phrasing techniques): Offers a powerful technique of iterative refinement and task decomposition.
    • Cluster 6 (Context and memory): The whole point of the method is context management. The draft acts as an external "memory" that steers further search and generation.
    • Cluster 7 (Reliability and stability): The method directly fights hallucinations and incompleteness, since every iteration relies on external information retrieval (RAG) to "ground" and refine the draft.
  • Practicality checklist (+15 points): Yes, the study shows how to structure complex requests, reveals non-obvious LLM behavior (failure under linear generation) and offers a way to improve accuracy. The 15-point bonus applies.
03

Numeric Usefulness Score

Arguments for a high score (92/100): The study offers not just a "trick" but a fundamental, intuitive strategy for tackling complex tasks. The analogy with how a human writes (outline -> draft -> research -> edits) makes a complex concept accessible. For any user who has struggled with incomplete or shallow answers to a hard request, this method is a real revelation. It moves LLM interaction from a "question-answer" format to a "working on a project together" format. It's one of the most powerful and versatile techniques for advanced users.

Counterarguments (why not 100): * Takes effort: The method isn't a "magic phrase" you can drop into a prompt for an instant boost. It requires the user to participate actively and run a multi-step conversation. The user has to simulate the "draft -> search -> refine" loop by hand, which can be laborious. * Indirect application: The paper describes an automated system (an agent). The user applies not the system itself but its logic. That takes some thinking and adaptation, unlike direct instructions such as "use XML tags".


Research digest

Key result

The longer and more complex the document, the worse one big prompt works. The model tries to cover everything at once and starts making things up. The TTD-DR method (Test-Time Diffusion Deep Researcher) lets you build accurate, detailed reports iteratively, with no fine-tuning and no special tools. The key: start with a deliberately incomplete draft, not a request for the final text. The draft reveals the holes. You fill the holes with real data. The model stitches the data back in, and the draft gets more accurate. Three or four rounds like this turn a sketch into a polished document.

Principle

A four-step loop: draft → find the holes → search → refine. Repeat. The big shift: the model doesn't generate from scratch, it improves what already exists. It's an editor, not an author. An editor works with concrete text and sees what's weak and what's missing. An author starting from a blank page invents everything. Invented stuff is hallucination.

Why it works

A long document means hundreds of details at once. The model can't hold them all. The draft is external memory. You don't need to keep the plan in your head; it's already on paper. Each next step has a narrow job: find the holes, fill a specific gap. Narrow task = fewer hallucinations. Real search data replaces fiction with facts.

When to apply

Any long structured document: a business plan, a marketing strategy, a video course script, a market analysis. Especially when you need accuracy: concrete numbers, verifiable facts, recommendations grounded in reality rather than in what the model 'sort of remembers'. Not for short tasks; there, a single prompt is faster.

Mini recipe

1. Ask for a draft: request a rough plan or first version. Say explicitly that it's a draft, not the final. Accuracy doesn't matter; you need structure. 2. Find the holes: ask the model to analyze the draft and name 4-5 specific search questions that would make the plan real. 3. Fill the gaps yourself: find the answers online or in professional sources. Copy the key facts; it's 10-15 minutes of work. 4. Refine the draft: paste what you found into the prompt and ask for the draft to be updated with the real data. 5. Repeat the loop: 2-3 iterations, and the sketch has become a document.

Examples

[BAD]: `Write a detailed quarterly marketing campaign plan for a new product` [GOOD]: Step 1: `Create a draft marketing plan for [product]. This is a first version; accuracy doesn't matter, I need a working structure. At the end, list what's missing to make the plan concrete` Step 2 (after you get the draft): `Analyze this plan. Name 4 specific questions we need answered for the plan to become realistic. Phrase them as web search queries` Step 3 (after searching): `Here's what I found: [results]. Update the draft, adding this data wherever it makes the plan more concrete. Mark [FACT:] wherever you use real data`

In plain words

The gist of Deep Researcher: the model stops guessing and starts building a route like a seasoned detective. Instead of dumping the standard guidebook list of sights on you, the model uses Test-Time Diffusion. That means it doesn't just generate text word by word; it keeps refining the plan, cutting what's extra and drilling into details. It understands that planning a trip for a family with kids isn't one task but a hundred little subtasks that need to be tied together with logic, not just duct-taped.

It's like hiring a meticulous assistant who doesn't just google "tickets to Rome" but first draws a huge map of connections on a whiteboard and then starts diffusively refining every pixel. First it's a sketch, then a sharp picture. If it turns out midway that the Colosseum with a stroller is pure hell, the assistant doesn't wait for your feedback; it rebuilds the whole route itself until the picture is perfect. It's not a linear list but a living blueprint that self-corrects as it "thinks".

The main lever here is decomposition and managed context. The model breaks your request into atoms: logistics, food, entertainment for the little ones, budget. Instead of drowning in a huge pile of data, it builds a dynamic search tree. Each step pulls in only the info it needs, so the model doesn't hallucinate from a context overdose. When it's looking for a hotel in Tuscany, it isn't thinking about the Venice train schedule at that moment, which lets it keep surgical precision on the details.

The example here is a vacation, but the principle is universal. This thing works just as well for writing complex code, analyzing a market or preparing a research paper. Anywhere you need not just "write some text" but a deep investigation with a ton of dependencies, Deep Researcher runs circles around ordinary chatbots. It's the jump from a simple chat to a full-blown autonomous agent that can think and check itself at every step.

Bottom line: the era of dumb, head-on answers is ending, and the age of deep planning is starting. If the model used to be fancy autocomplete, now it's a powerful analytical engine that isn't afraid of complex chains of actions. 6 context-management elements turn chaotic searching into a structured result. Either you use tools like this for complex tasks, or you keep double-checking every comma after the bot by hand, wasting time and nerves.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on TTD-DR: Iteratively Refine a Draft Instead of Chasing the Perfect First-Try Prompt arXiv:2507.16075

Sign in to apply this study New accounts get 50 free credits.

Get the week’s best papers by email

One email on Sundays with the highest-rated new techniques. Unsubscribe with one click.