Apply to my task
arXiv:2610.09593 ★ 89 Oct 7, 2026

Structured pre-generation elicitation: answer the questions first, then get the document

Key result

One in three documents missed the topic when people were allowed to write one line and wait for the result. The method lets you get plans and strategy memos built around your choice, not smooth averaged-out text. The model doesn't write right away. It asks 3 questions, offers 3-4 position options, you pick one and explain why. Only then comes the synthesis of the document. Quality rose by about a third at the cost of 2-3 extra minutes.

01

TL;DR

The method is simple: before the model writes the document, it asks you questions. You answer three clarifying questions (what matters most, what resources you have, who the reader is), pick one of several ready-made strategic options and write a couple of lines on why you chose it. Only then does the model assemble the final text from your answers.

The core pain is the "just ask it" prompt. People write one line, and the model answers the wrong question. In the control group, one in three documents missed the topic because the prompt didn't contain the heart of the problem. Even people who described the problem correctly got smooth, polished texts with no clear position and no honest breakdown of "what we lose, what we gain". The model guesses what you want, and it guesses the average.

First you lock in context, choice and rationale, then generation happens. It costs 2-3 extra minutes. In the experiment, document quality rose by about a third. The biggest gains were in strategic coherence and trade-off analysis. The scheme added no technical specificity (laws, regulations, figures).

Want this for your own case? Apply this study to your task: AI adapts its method to what you are working on and writes the prompt.

02

Method Blueprint

STEP 1: You describe the task in your own words → a short prompt
STEP 2: The model asks 3 clarifying questions (priority, resources/infrastructure, audience) → you answer
STEP 3: The model offers 3-4 "cards" — strategic position options → you pick one
STEP 4: You write your rationale for the choice in your own words → 2-4 sentences
STEP 5: The model synthesizes the document from everything collected → a finished plan/memo

It can all be done in a single chat. Generation starts only after step 4.

03

Example in Practice

Task: The owner of a home-goods store on Amazon. The marketplace raised its fees, margins dropped, and there's a meeting with partners in a week. They need a 30-day plan. This is a task about choosing a strategy and making trade-offs, which is where the method shines. If you need precise tax or customs regulations, the method won't help: you need a specialist for that.

Prompt:

I own a home-goods store. 80% of sales go through Amazon. As of the 1st, fees went up and my margin fell from 22% to 11%. I have a meeting with my partners in a week. I need a 30-day action plan.

Don't write the plan right away. Let's work step by step:
1. Ask me exactly 3 clarifying questions: my main operational priority, my current infrastructure and resources, and the main reader of the plan. For each, give 3-4 answer options plus "other".
2. Wait for my answers.
3. Propose 3-4 strategic position options, each with one line of "what we gain / what we lose". Wait for my choice and my rationale.
4. Only after that, write the 30-day plan.

Result: The model will first ask three questions with answer options (for example, what matters more: keeping revenue or restoring margin). Then it will show several strategy "cards", such as "stay and raise prices", "diversify channels", "move to your own Shopify store". Each will have a short "gain / lose". After your choice and rationale, you get a 30-day plan built around your choice. It will include a trade-off breakdown, not a pile of generic advice. Double-check exact figures on fees and taxes yourself.

04

Why It Works

The model's weakness. It doesn't know your context. If the task is described in one line, the model fills in the gaps with an average guess. The result: either an answer about the wrong thing, or a smooth text with no position. People are also bad at noticing these failures. In the experiment, self-rated quality barely matched the actual scores.

The strength. The model is good at synthesizing material when it's specific and structured. It's also good at asking substantive questions and laying out options with pros and cons. It doesn't need to guess; it needs to assemble.

How the method uses this. You make the decision (the direction and the reasons), and the model writes it up. The document is built around your choice, so it has an explicit position and an honest breakdown of "what we lose". You also stay engaged in the reasoning: participants felt more strongly that they had shaped the plan themselves.

Control knobs: - Number of questions. For simple tasks 1-2 is enough; for complex ones, 4-5. More questions, more time. - Strategy cards. Ask the model to make the options opposite in spirit (aggressive / cautious / middle ground). That makes the choice more meaningful. - Rationale. This is the most "human" part. Skip it and you lose engagement, and possibly some quality too. The paper didn't isolate this, so nobody knows for sure. - Document reader. The audience question sets the tone. The same plan gets written differently for a board of directors and for the team.

05

Prompt Template

Task: {task and context in 2-3 sentences}

Don't write the final document right away. We'll work in 4 stages.

STAGE 1. CLARIFICATION
Ask me exactly 3 questions:
— Main priority: {what exactly needs clarifying: timeline / margin / risk / reputation}
— Infrastructure and resources: {what I have: people, systems, budget}
— Main reader: {who will read it and make the decision}
For each question, give 3-4 answer options and an "other" option.
Stop and wait for my answers.

STAGE 2. CHOOSING A POSITION
After my answers, propose {number_of_options} strategic position options.
For each: a name, the gist in one line, "what we gain", "what we lose".
Stop and wait for me to pick an option.

STAGE 3. RATIONALE
Ask me to explain in 2-4 sentences why I chose this particular option.
Stop and wait.

STAGE 4. SYNTHESIS
Only now write the {document_type}, based on my answers, the chosen position and my rationale.
Required: explicitly show the trade-offs of the chosen path and how each step connects to the chosen position.
No fluff. Flag separately anything that needs to be checked by a specialist (regulations, figures, legal details).

What to fill in: - {task}: the situation, with numbers and deadlines. - You can swap the three questions for your field, but keep the idea: priority → resources → reader. - {number_of_options}: 3-4. - {document_type}: a 30-day plan, a memo, a pitch, a strategy.

🚀 Quick start: paste into the chat:

Here is a template for a step-by-step "questions first, then the document" workflow. Adapt it to my task: [your task].
Ask me questions to fill in the fields.

[paste the template above]

The LLM will ask about the task's context, who will read the document and what constraints you have on time and resources. It needs these so that the three clarifying questions and the strategy cards in the template are about your situation, not generic. It will take the pattern from the template and build a working prompt.

06

Limitations

⚠️ Most of the effect comes from rescuing weak prompts: About 60% of the overall gain is explained by the fact that without the method, documents often missed the topic. If you already describe your task in detail, the gain is more modest. But even for people who described the problem correctly, it was noticeable, about a fifth.

⚠️ Specificity doesn't improve: Technical and regulatory accuracy barely improved. The scheme provides structure and a position, not knowledge. Check laws, figures and standards separately.

⚠️ You won't notice that it got better (or worse): Self-rated quality is barely related to the actual scores, with or without the method. You can't rely on the feeling of "this is a good document".

⚠️ Nobody knows which part works: The study compared the whole package (questions + choice + rationale) against a single prompt. It didn't isolate which element produces the effect.

⚠️ One task, one generation model, a fictional scenario: Everything was tested on a single made-up crisis, and participants were online respondents, not real executives. Applying it to your business is a reasonable hypothesis, not a proven fact.

⚠️ Quality scoring is shaky: The scores from two LLM judges and a human diverged a lot in absolute points and agreed better on the "better/worse" ranking. The experiment wasn't publicly preregistered. The memory effect is a weak signal; it didn't survive robustness checks.

⚠️ The cost is time: On average 2-3 minutes longer. For a simple task, that's overkill.

07

How They Studied It

Researchers from the Oxford Centre for Impact Research collected 400 sessions on the Prolific platform. Participants were managers and professionals from various countries. Each was given the same fictional crisis: two weeks before a launch in Singapore and Malaysia, the regulator requires data to be stored on local servers, while the company's entire architecture sits in Frankfurt. They had to write a prompt and get an action plan. One half got a response to their prompt right away (196 sessions). The other half went through three questions, a strategy choice and a rationale (204 sessions). The plans were scored on four criteria (coherence, technical specificity, trade-off analysis, density of thought) by two LLMs and one human, none of whom knew which group was which.

The result jumps out right away: all three raters saw an improvement, although the size varied a lot. On average +32% (on a 4-to-40 scale: 15.5 vs. 20.5). The most interesting part is inside the numbers. In the control group, 34% of documents were rated off-topic because the prompt lacked the heart of the problem. In the method group, it was 5%. But when the authors looked separately at participants who described the problem correctly on their own, the method still gave +21%. So the benefit isn't just a "hint about the core issue", but also the structure itself: "chose a position, explained it, got the text". Trade-off analysis and coherence went up, while technical accuracy stayed flat. The method helps you think and structure, but it doesn't replace an expert. Participants in the method group felt more engaged, and it cost them 2.4 minutes.

08

Adaptations and Extrapolations

🔧 Technique: add a fact-check stage → patch the method's weak spot

The method didn't improve technical accuracy. Add this to the end of the template: "After the document, give a separate list of every claim, figure and regulation I should verify with a specialist or in the primary source, with a note on how confident you are in each". This is my own adaptation; the paper had no such step.

🔧 Technique: drop the ready-made cards → the model builds options from your context

If your task is unusual, in "Stage 2" ask: "Based on my answers, propose 3 position options that differ sharply in risk and speed". That keeps the options from being cookie-cutter.

Extrapolation: moving it into an agent's instructions. The "questions and choice first, then the result" idea can be written into a system prompt or an agent's instruction file. The paper didn't test agents; this is my hypothesis:

For any task involving strategy, planning or architecture, before writing the result:
1) ask no more than 3 clarifying questions about the priority, constraints and who will read the result;
2) propose 3 approach options with "what we gain / what we lose";
3) wait for my choice and a short rationale;
4) only then prepare the final document or plan.
Skip this sequence for small, unambiguous tasks.
09

Resources

  • Paper: Structured pre-generation elicitation versus single-shot prompting in AI-assisted enterprise decision-making: a randomised online experiment (working paper).
  • Author: William Scott-Jackson, Oxford Centre for Impact Research (OCIR). The prototype scaffolding layer is called Cognistance.
  • Key works cited in the paper: "cognitive surrender" (Shaw & Nave), "workslop" (Niederhoffer et al.), cognitive forcing functions (Buçinca et al.), metacognitive demands of generative AI (Tankelevitch et al.), the consultant experiment (Dell'Acqua et al.).

Research digest

Key result

One in three documents missed the topic when people were allowed to write one line and wait for the result. The method lets you get plans and strategy memos built around your choice, not smooth averaged-out text. The model doesn't write right away. It asks 3 questions, offers 3-4 position options, you pick one and explain why. Only then comes the synthesis of the document. Quality rose by about a third at the cost of 2-3 extra minutes.

Principle

A process with four stops: questions → position cards → your rationale → document. Generation comes at the very end. Before that, the model has to collect three things: context, choice and reasons. You make the decision; the model just turns it into text. The three questions are always the same: main priority, resources, reader. The position cards look like this: a name, "what we gain", "what we lose". It's like an architect. First they question the client and show sketches, and only then draw the blueprints.

Why it works

The model doesn't know your context. Give it one line in the prompt and it fills in the rest with an average guess. You get either an answer about the wrong thing or an even-toned text with no position. In the experiment, about 60% of the gain came from "rescued" weak prompts. But even for people who described the problem correctly, quality rose by about a fifth. Strategic coherence and trade-off analysis improved the most. The model doesn't need to guess; it needs to assemble from concrete pieces. That it can do. The funny part: participants themselves barely saw a difference. Their rating of their own document barely matched the real one. Don't trust the feeling that "it turned out well". Being honest about the downsides. Specificity (laws, regulations, figures) didn't improve. It was tested on one made-up task and online respondents, not real executives. The study didn't isolate which part of the scheme produces the effect.

When to apply

Strategic decisions → a 30-day plan, a memo for partners or the board, a pitch, especially when you're choosing between paths and each has its own price. The method also helps when you write a one-line prompt and know for sure the context in it is incomplete. NOT a fit for precise regulations, taxes, customs and legal details. You need a specialist there. For simple tasks the method is overkill too: you'll waste two or three minutes.

Mini recipe

1. Describe the task as usual: 2-3 sentences with numbers and deadlines. 2. Forbid writing right away: add `Don't write the document right away. Let's work step by step.` 3. Ask for exactly 3 questions: priority, resources, reader. For each, 3-4 options and an "other" option. 4. Answer and wait for the cards: have the model give 3-4 positions with "gain / lose". Ask for options that differ in spirit: aggressive, cautious, middle ground. 5. Pick one and explain: 2-4 sentences in your own words. Don't skip this step; it's the most "human" one. 6. Only now ask for the document: require it to show the trade-offs and tie each step to the chosen position. 7. Flag what needs checking: the model should set apart everything about regulations and figures. Check those yourself.

Examples

[BAD]: `My margin dropped because of marketplace fees. Write a 30-day plan.` [GOOD]: `I own a home-goods store. 80% of sales go through Amazon. As of the 1st, fees went up and my margin fell from 22% to 11%. I have a meeting with my partners in a week. I need a 30-day plan. Don't write the plan right away. First ask exactly 3 questions: main priority, resources, reader of the plan. For each, give 3-4 options and "other". Then propose 3-4 positions with "what we gain / what we lose" and wait for my choice and rationale. Only after that write the plan. Flag everything about taxes and fees for verification.` In the first case the model will give a pile of generic advice. In the second, the plan will be built around your choice, for example "diversify channels", with an honest breakdown of what you give up.

In plain words

AI spits out bland corporate BS not because it's dumb, but because you're too lazy to give it context. When you feed it a task in one line via a single-shot prompt, the model goes for the lowest common denominator: it makes up your constraints for you and serves smooth but useless filler. The worst part: people are blind to their own failures and seriously rate that text as high quality, even though its practical value is zero.

It's like running into an expensive consultant's office yelling "write me a strategy" without mentioning your debts or your team. The expert will politely pour out twenty pages of abstract jargon, and you'll be left with a pretty empty shell that has nothing to do with reality. The experiment proved this with numbers: without context, the model just fills in the gaps at random. You get a classic dialogue of the deaf, where everyone enjoys the process but the result is a total flop.

The working fix is a structured interview before generation. The model doesn't rush headlong into writing the document; first it grills you: it asks three specific questions about priorities, resources and the target audience. Next it lays out the forks in the road, you pick one, write a couple of lines of reasoning, and only then does the AI assemble a draft. You set the direction, and the model works as a technical assembler of meaning, with no freelancing on its own.

The explainer demos the method on marketplace sellers trying to save their margins, but the principle is completely universal. A one-month crisis plan, launching a tricky feature or a pitch to partners: the approach is ideal wherever there's uncertainty and trade-offs. For looking up tax codes it's useless, you need a specialist there, but for management decisions this format blows ordinary prompts out of the water.

Bottom line: stop expecting one-click magic from the model and make it drag the details out of you. An interview before generation saves hours of pointless edits and burns away template nonsense at the root. Spend two minutes on thoughtful answers and walk away with a working plan with a clear position. Too lazy to answer the questions? You get diplomatic mush and are left wondering why your business went under.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on Structured pre-generation elicitation: answer the questions first, then get the document arXiv:2610.09593

Sign in to apply this study New accounts get 50 free credits.