Apply to my task
arXiv:2512.10273 ★ 89 Dec 10, 2025

RT-ICA: Reverse Thinking to Spot Missing Information

Key result

Finding: CoT and ToT go from the data to the answer. They have no built-in mechanism to ask 'do I have everything?'. RT-ICA lets you find missing data BEFORE the model starts hallucinating. The method flips the direction: the model starts with the goal ('what do I need to find?'), builds a list of required conditions ('what's needed for that?'), and checks each one ('is it in the problem?'). Gaps become visible before any attempt to solve.

01

TL;DR

RT-ICA (Reverse Thinking for Information Completeness Assessment) is a technique that makes the model work from the goal back to the prerequisites instead of from the data to the answer. Instead of trying to solve the problem with whatever it has, the model first lists what's needed to solve it, then checks whether that's actually in the problem statement. If something's missing, it names exactly what.

Forward methods (Chain-of-Thought, Tree-of-Thought) move forward: they take the data and pull the reasoning toward an answer. They assume the data is sufficient. If it isn't, the model will still give an answer, just a wrong or made-up one (a hallucination). CoT has no built-in way to ask itself, "Do I actually have everything I need?" That's not an implementation bug — it's a fundamental limitation of reasoning in the forward direction.

RT-ICA flips the process: the model starts with the question "what am I trying to get?", then builds a list of required conditions (what has to be known to compute this?), and checks each condition — is it given in the problem or not. The conditions that aren't there are the missing information. The method runs in three steps inside a single prompt: (1) define the goal, (2) list the prerequisites, (3) check whether each one is available.

Want this for your own case? Apply this study to your task: AI adapts its method to what you are working on and writes the prompt.

02

Method Blueprint

Everything happens in one prompt:

STEP 1: Define the final goal
→ What needs to be found? Call it X

STEP 2: List the required conditions
→ What must be known in order to find X?
→ List: Condition_1, Condition_2, ..., Condition_N

STEP 3: Check whether each condition is available
→ For each condition:
   - Given explicitly in the problem? → available
   - Can be inferred from context? → available
   - Nowhere to be found? → MISSING

CONCLUSION: If at least one condition is missing → list exactly which ones
03

Example in Action

Task: You're sanity-checking a friend's business idea — opening a coffee shop in a residential neighborhood. He says: "Average ticket is $6, foot traffic is 200 people a day, conversion is 15%. Rent is $4,000, and two baristas at $3,000 each. Will it pay for itself in six months?" You want to know: is there enough data to run the numbers, or is something critical missing?

Prompt:

Use reverse thinking to check whether the data is complete:

PROBLEM: {Open a coffee shop in a residential neighborhood. Average ticket $6,
foot traffic 200 people/day, conversion 15%. Rent $4,000/month,
two baristas at $3,000 each. Will it pay for itself in six months?}

STEP 1 — Final goal:
Define what needs to be found to answer the question.

STEP 2 — Required conditions:
List ALL the parameters that must be known to calculate payback.
For each parameter, specify: numeric values, formulas, relationships.

STEP 3 — Availability check:
For each condition on the list, check:
- Is it given explicitly in the problem?
- Can it be inferred from context?
- Is there no information anywhere?

CONCLUSION:
If all conditions are available → "The data is sufficient"
If some are missing → list specifically what's missing and why it's critical

Result:

The model will show a step-by-step analysis: it defines the goal (calculating the payback point), lists all the required parameters (revenue, operating expenses, upfront investment, taxes, cost of goods for the drinks), and checks each one against the problem. At the end it outputs a list of what's missing: cost of coffee and supplies, utilities, the size of the upfront investment (equipment, build-out), the tax setup, other operating expenses. And it explains why the calculation is impossible without each item.

04

Why It Works

By default, an LLM generates text forward — from start to finish, from data to conclusion. When the model sees a problem, it immediately tries to solve it with what it has. If the data falls short, it fills in the blanks, guesses, or misses the problem entirely. It has no natural incentive to stop and ask, "Do I really have everything?" Forward reasoning assumes the input data is complete.

The reverse direction turns gap-hunting into a routine task. Models are good at breaking a goal into components ("to compute X, you need A, B, C") and comparing lists ("is A in the problem? what about B?"). That's much easier than noticing mid-solution that some parameter was never given. Reverse thinking makes the completeness check explicit and structured rather than a side effect of trying to solve the problem.

Prompt control knobs:

  • Decomposition depth — ask it to "list second-level conditions" (what's needed for the prerequisites themselves) → you'll find deeper gaps, at the cost of more tokens
  • Strictness of the check — add "only count it as missing if it can't be inferred in any way" → fewer false alarms
  • Output format — drop "for each condition, check" and ask for the list of missing items directly → faster, but less transparent
05

Prompt Template

Use reverse thinking to check whether the data is complete:

PROBLEM: {problem description}

STEP 1 — Final goal:
Define what needs to be found or solved in this problem.

STEP 2 — Required conditions:
List ALL the conditions, parameters, data, and relationships
that must be known to reach the goal.

STEP 3 — Availability check:
For each condition, check:
- Is it given explicitly in the problem?
- Can it be inferred from the available information?
- Is the information missing?

CONCLUSION:
If all conditions are available → write "The data is sufficient to solve this"
If some are missing → list specifically WHAT is missing and WHY it's critical

Fill in: - {problem description} — any task where you need to calculate, estimate, verify, or make a decision


🚀 Quick start — paste into a chat:

Here's an RT-ICA template for checking data completeness. Adapt it to my task: [your task].
Ask me questions to fill in the fields.

[paste the template above]

The LLM will ask about the specifics of your task, because different domains call for different kinds of conditions (finance needs one set of parameters, technical specs another). It'll take the reverse-thinking pattern from the template and tune it to your context.

06

Limitations

⚠️ False alarms: The model may flag as "missing" something that's implicitly given or derivable from general knowledge. For example, if a proportion problem doesn't state one quantity explicitly but it can be computed from the others, the model may still say "not enough data". This is especially an issue with problems that have multiple equivalent formulations — when the task can be solved several ways using different sets of data.

⚠️ Vague gap descriptions: When the model correctly finds what's missing, it sometimes describes it in overly general terms ("additional information is needed") instead of pinpointing it ("the unit cost of the product isn't specified"). The reader has to fill in the specifics themselves.

⚠️ More tokens: The method uses 2.3x more tokens than standard Chain-of-Thought and runs 1.8x longer. For complex problems with a long list of conditions, the bill can add up.

07

How They Tested It

The researchers took two math benchmarks (GSM8K and Math500) and deliberately broke some of the problems by hand — removing critical data from the problem statements. That produced 105 problems from GSM8K (52 incomplete + 53 normal) and 101 from Math500 (39 incomplete + 62 normal). Several annotators checked each broken problem to make sure the data really was missing and couldn't be inferred from context.

The models' job was to determine whether there's a gap, without access to the correct answer. They tested three models: GPT-4, GPT-3.5-turbo, DeepSeek-V3. They tracked three metrics: overall accuracy (correct call on any problem), accuracy on incomplete problems ("yes, something's missing"), and accuracy on complete problems ("no, it's all there").

The results were most impressive for the weaker models: GPT-3.5-turbo on the GSM8K dataset jumped from 30.77% to 82.69% at spotting incomplete problems — nearly tripling. For GPT-4 the gain was more modest (from 61.54% to 76.92%) but still significant. Why the difference? Strong models already partly "sense" what's missing thanks to their training, while weaker ones need an explicit thinking structure. Reverse thinking gives them that structure.

An interesting finding: the method barely hurt the ability to recognize complete problems (where everything is there). DeepSeek-V3 even improved from 82.26% to 98.39% on the complete Math500 problems. That means reverse thinking doesn't turn the model into a paranoid that sees gaps everywhere — it just adds rigor.

The authors were upfront about the trade-off: 2.3x more tokens. But that's the price of a model that no longer hallucinates answers to questions it lacks the data for, and instead honestly says "I'm missing X and Y".

08

Adaptations and Extrapolations

🔧 Technique: Two-level check → finds dependencies deeper down

Add after STEP 2:

STEP 2.5 — Check second-level conditions:
For each condition from STEP 2, ask: "What's needed for this condition ITSELF to be satisfiable?"
List the second-order prerequisites.

This finds hidden dependencies — for example, "calculating profit requires cost of goods" → "cost of goods requires supplier prices and purchase volumes". Useful for complex, multi-layered problems.

🔧 Technique: Critical items only → fewer false alarms

In STEP 3, add:

Mark something as missing ONLY if:
1. The information can't be derived from the available data in any way
2. The calculation is impossible without it (not just "it would be more convenient")

Cuts down on false alarms about implicitly given information.

🔧 Combining with Chain-of-Thought: check completeness first, then solve

STAGE 1 — Completeness check (reverse thinking):
[RT-ICA template]

STAGE 2 — Solution (forward reasoning):
If the data is sufficient:
Solve the problem step by step, explaining each step.

If the data is NOT sufficient:
Solve the problem under the following ASSUMPTIONS: [plug in reasonable values for what's missing]
Clearly state that these are assumptions, not facts.

Useful when you need some kind of answer even if data is missing — the model will give an estimate but will honestly say "this assumes X is roughly Y".

09

Resources

Reverse Thinking Enhances Missing Information Detection in Large Language Models
Yuxin Liu, Chaojie Gu, Yihang Zhang, Bin Qian, Shibo He
Zhejiang University

References from the study: - Chain-of-Thought Prompting [Wei et al., 2022] - Tree-of-Thought [Yao et al., 2023]
- Fill-in-the-blank reasoning [Deb et al., 2024] - Reverse-enhanced thinking [Chen et al., 2024] - GSM8K benchmark [Cobbe et al., 2021] - Math500 benchmark [Hendrycks et al., 2021]

Research digest

Key result

Finding: CoT and ToT go from the data to the answer. They have no built-in mechanism to ask 'do I have everything?'. RT-ICA lets you find missing data BEFORE the model starts hallucinating. The method flips the direction: the model starts with the goal ('what do I need to find?'), builds a list of required conditions ('what's needed for that?'), and checks each one ('is it in the problem?'). Gaps become visible before any attempt to solve.

Principle

Forward methods go from the data to the answer. They assume the data is sufficient. If it isn't, the model still produces an answer, just a wrong one. RT-ICA goes from the goal to the prerequisites: first list what's needed to solve it, then check whether it's in the problem. What's missing surfaces on its own.

Why it works

By default an LLM tries to solve with what it has. If data is missing, it fills in the blanks or guesses. It has no incentive to stop and ask 'do I really have enough?'. The reverse direction turns gap-hunting into a routine task: the model is good at breaking a goal into parts ('X needs A, B, C') and comparing lists ('is A in the problem?'). That's easier than noticing a gap mid-solution.

When to apply

Business calculations (payback, unit economics) → specifically for checking whether the input data is complete, especially when you need to know WHAT exactly is missing for the calculation. Technical specs, project estimates, financial analysis. NOT for cases where the problem is clearly complete and the issue is the solution logic, not the data.

Mini recipe

1. Define the final goal: What needs to be found or solved in this problem? 2. List the required conditions: ALL the parameters, data, and relationships that must be known to reach the goal 3. Check each one's availability: Given explicitly? Can be inferred? Nowhere to be found? If anything's missing, list specifically WHAT is absent and WHY it's critical

Examples

[BAD]: `Check whether the data is complete for calculating the coffee shop's payback` [GOOD]: `Use reverse thinking. STEP 1: Define what needs to be found. STEP 2: List ALL the parameters for calculating payback (revenue, expenses, investment). STEP 3: For each parameter, check — given in the problem? can be inferred? nowhere to be found? CONCLUSION: If all are available — 'the data is sufficient'; if not — list specifically what's missing`

In plain words

In Plain Words: 2512.10273

In Plain Words

Reverse Thinking Enhances Missing Information Detection inLargeLanguageModels

When you give an AI a task, it behaves like a hyperactive intern: it dives right in, even if the brief has holes the size of the Grand Canyon. The problem is baked into how LLMs work — they're trained to generate text forward, from the first word to the last. If data is missing, the model won't say "stop"; it'll just start hallucinating or plug in some generic average, anything to produce an answer. It's optimistic by design and believes your prompt already contains everything it needs.

It's like going to a doctor and saying, "My side hurts, write me a prescription." A bad doctor scribbles down a pill name on the spot; a good one first draws up a list of tests without which no diagnosis is possible. The RT-ICA method (Reverse Thinking) turns the AI from a hasty amateur into that meticulous doctor. Instead of frantically hunting for an answer in your scraps of data, the model first lays out the ideal set of conditions needed for a solution, and only then checks it against reality.

It works through reverse thinking: first the model writes a checklist of "what I'd need to know in theory", then it goes item by item looking for each one in your text. If you ask about the payback period of a coffee shop but forgot to mention taxes or the cost of beans, the model won't guess. It'll say plainly: there isn't enough information, because items 4 and 5 on my list of required variables are empty. That turns the process from blind guesswork into a structured audit, where missing data is itself a valuable result.

The method was tested on logic problems, but the principle is universal for any complex analysis. You can and should plug it into prompts for evaluating business plans, reviewing contracts, or writing code. Anywhere the cost of a mistake is high, make the model design the solution first instead of blurting it out. It cures the main disease of today's chatbots — their pathological urge to please you at any cost, even at the cost of outright misinformation.

Long story short: if you want a sane result, stop asking "what's the answer" and start asking "what am I missing to answer this". RT-ICA proves that AI models are much smarter when they're allowed to doubt and to stress-test the incoming data. Either you invest in reverse reasoning, or you get a confident answer that turns out to be complete garbage on closer inspection. Teach your prompts to "think backwards" and you'll stop catching hallucinations that were really just missing inputs.

ArXiv ID: 2512.10273 | Generated: 2026-01-02 17:00 | Nova Research

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on RT-ICA: Reverse Thinking to Spot Missing Information arXiv:2512.10273

Sign in to apply this study New accounts get 50 free credits.