Apply to my task
arXiv:2608.01347 ★ 95 Aug 2, 2026

"Compare several approaches": the phrase that makes AI coding agents burn 2-7x more tokens for nothing

Key result

Ask a model to "develop several approaches and compare them before choosing" — and it dutifully inflates reasoning tokens by 2.4–7.4x. The final code doesn't change by a single line. The bounded efficiency method lets you cut these hidden costs without losing quality — just by removing trigger phrases and adding clear task boundaries. The "scope + done criterion + stop condition" template doesn't increase tokens on any of the six tested models, and on GLM-5.2 it cuts spend in half with the same result.

01

TL;DR

Researchers tested how specific wording in a prompt affects the hidden "reasoning tokens" (what models like Claude, DeepSeek and Kimi spend on internal deliberation before answering) in AI agents that write code. It turns out some everyday phrases inflate those costs several times over without improving the solution one bit.

The headline finding: the phrase "develop several approaches and compare them before choosing" is the most expensive of everything tested. It raises reasoning-token spend by 2.4–7.4x on all six models checked, and this held up even on hidden, never-before-seen tasks. The model dutifully starts "juggling options in its head," even though the final solution comes out exactly the same as if it had been asked for one solution right away. Phrases like "think deeply" and "think carefully" have a similar effect — the model honestly spends longer deliberating, but the result doesn't change.

The fix is simple and free: a template with explicit task boundaries — what exactly to change, what the done criterion is, when to stop. That prompt doesn't increase token spend on any model, and on one of them (GLM-5.2) it cut spend in half at the same result quality.

Want this for your own case? Apply this study to your task: AI adapts its method to what you are working on and writes the prompt.

02

Findings at a Glance (what hurts, what's safe, what helps)

HARMFUL: "develop several approaches and compare" → ×2.4–7.4 reasoning tokens, quality unchanged
HARMFUL: "think deeply / carefully" → ×1.6–2.2 tokens, quality unchanged
RISKY: "tidy up around it", "act autonomously" → the model wanders into files outside the task
EXPENSIVE: wrong technical hints in the prompt → ×2.6 tokens (the model chases a false lead)
SAFE: verbosity, extra context, repetition → nearly free (×1.03), no need to skimp on explanations
HELPFUL: "scope + done criterion + stop condition" template → free, sometimes saves up to 2× tokens
03

Example in Action

Task: You ask Claude Code (or ChatGPT/Claude in extended-thinking mode) to fix a bug in an online store's discount function — it goes negative when the coupon is bigger than the order total.

Bad prompt (gut instinct — "the more detail, the better"):

Explore several different approaches to fixing this problem, compare their pros 
and cons, and pick the best one. Think step by step and check everything carefully. 
If you see anything else nearby that could be improved, fix that too.

Prompt using the "bounded efficiency" method:

Task: the calculate_discount() function returns a negative discount 
when the coupon is larger than the order total.

Scope: change only the file discount.py. Do not touch any other code.

Done criterion: the test test_discount_negative passes, 
and no other tests break.

Stop condition: as soon as the tests pass, stop. 
Do not look for extra improvements and do not suggest alternative solutions.

Result: The first prompt makes the model "juggle options in its head" — you'll see a longer wait and more reasoning tokens spent, and the final fix will be the very same. The second prompt delivers the same (or a better) result faster and cheaper — the model won't spend resources on an imaginary comparison and won't change code outside the specified file.

04

Why It Works

Reasoning models follow instructions literally — if you ask them to compare several approaches, the model honestly starts generating that comparison internally, even when the final answer doesn't change because of it. That's not cleverness or depth of meaning — it's extra text you're asking it to produce, and it's billed like any other tokens.

The strength of these models is that they respect explicit boundaries and stop conditions well. Tell them precisely what to do and when to finish, and the model won't "keep mulling" beyond what's needed.

The method exploits this: by removing triggers of excess reasoning ("compare," "think deeply") and adding a clear stop signal, you give the model a reason to finish earlier — with no loss of quality.

Control knobs: - Remove phrases like "compare several options," "consider different approaches" → token savings, if you don't need the comparison as an output - Add a "done criterion" and a "stop condition" → the model doesn't redo what already works - Remove "tidy things up," "act autonomously" → the model doesn't touch code outside the task (this is the only category of phrases that expands the scope of changes) - Don't fear long, detailed prompts → extra text barely raises the cost, so there's no need to skimp on explaining context - Verify technical hints before putting them in the prompt → a wrong guess about the architecture is the most expensive thing of all — the model conscientiously follows the false lead

05

Prompt Template

Task: {short description of the problem}

Scope: change only {specific files/functions}. 
Do not touch any other code.

Done criterion: {what must work / which tests must pass}

Stop condition: as soon as the criterion is met, stop. 
Do not look for extra improvements and do not suggest alternative solutions.

Fill {short description of the problem} with the concrete gist of the bug or task, {specific files/functions} with the exact boundaries the model is allowed to touch, and {done criterion} with a clear sign the task is solved (a test passes, the function returns the right value, etc.).

🚀 Quick start — paste into the chat:

Here is a prompt template for a lean, precise request to an AI coding agent. 
Adapt it to my task: {your task}. 
Ask me questions to fill in the fields.

[paste the template above]

The LLM will ask about the specific files, the done criterion and the task boundaries — because those three things are exactly what strip away the model's excess "reasoning" without hurting quality.

06

Limitations

⚠️ Task size: the effect was measured on small tasks (up to 4 files). On large projects the result may differ — the researchers say so directly.

⚠️ The model matters: on newer "frugal" models (e.g., Kimi K3) the relative effect is stronger (the "think deeply" phrase inflates spend ~15x), though absolute token spend still stays low — don't panic over percentages, look at the real numbers.

⚠️ The tool matters more than the prompt: the same prompt can cost 5–30x more depending on which interface you work through (e.g., Claude Code versus other agent shells) — that's not always in the user's hands, but it's worth knowing when you pick a tool.

⚠️ Cache discounts aren't efficiency: if a provider shows your bill went down thanks to caching, it doesn't mean the model got more efficient — it does the same work, you're just charged less for the repeated parts of the prompt.

07

How They Studied It

The team took six large "thinking" models (DeepSeek, Kimi, Nemotron, GLM and others) and ran them through two different agent interfaces on 24 deterministic coding tasks — with hidden tests the agent can't see while working. In total they collected more than 4,600 valid runs costing about $166 in real spend.

A key design detail: all hypotheses and thresholds for "what counts as harmful" were locked in before the researchers looked at the results — that guards against fitting conclusions to the data. Some findings were additionally checked on 8 tasks that played no part at all in selecting the "harmful" phrases — and most effects held up.

The biggest surprise: when the new Kimi K3 model came out a few days later, the team tested it straight out of the box using the same protocol — and although the relative effect of harmful phrases was even stronger (the model is "frugal" by default, so any extra instruction stands out more against its baseline), absolute token spend stayed at or below that of the previous models. An important lesson: relative growth percentages can look scary, but you need to look at the absolute numbers.

They also tested the effect on the closed model Claude Sonnet 5 through the official API — and most findings replicated, though an interesting detail emerged: the "think deeply" phrase barely hurts this particular model (it decides on its own how much to think), while the phrase about "maximum confidence in the solution" turned out to be the most expensive there.

08

Resources

Sarel Weinberger, Amir Hozez (PointFive). "Prompt-Induced Waste in Large Reasoning Models: A Preregistered Two-Harness Benchmark of Coding Agents", July 2026. Code, tasks, prompt variants and usage logs are published: github.com/sarelWeinberger/prompt_efficiency

Research digest

Key result

Ask a model to "develop several approaches and compare them before choosing" — and it dutifully inflates reasoning tokens by 2.4–7.4x. The final code doesn't change by a single line. The bounded efficiency method lets you cut these hidden costs without losing quality — just by removing trigger phrases and adding clear task boundaries. The "scope + done criterion + stop condition" template doesn't increase tokens on any of the six tested models, and on GLM-5.2 it cuts spend in half with the same result.

Principle

A reasoning model is a literalist, not a thinker. Say "compare options" and it honestly starts generating a comparison internally, even if the final answer doesn't change. Reasoning tokens are billed like ordinary text — it's not "depth of thought," it's extra letters you ordered yourself. But that same literalness works in your favor: give a clear stop condition and the model stops thinking right after the criterion is met, instead of "mulling a bit more" out of politeness.

Why it works

A reasoning model can't tell a box-ticking comparison from one you actually need — it just executes the instruction literally and in detail. Worst of all are wrong technical hints in the prompt: the model conscientiously follows the false lead and spends 2.6x more tokens trying to fit the solution to the mistaken context. The key insight — the model can't question the task framing, it just executes it as thoroughly as possible. Verbosity and extra context, on the other hand, cost almost nothing — growth of just ×1.03, so you can explain the task in detail without worry.

When to apply

AI coding agents (Claude Code and similar tools) → for bug fixes, small refactors and targeted edits, especially when response speed and the token bill matter. Not a fit as the sole takeaway for large projects (more than 4 files) — the researchers haven't tested the effect there yet.

Mini recipe

1. Remove the triggers: strike phrases like "compare several approaches" and "think deeply/carefully" from the prompt — they don't affect the result, only the bill. 2. Set boundaries: state it plainly — change only the file discount.py, leave everything else alone. 3. Give a done criterion: a specific test or condition, e.g. "the function returns 0 when the coupon exceeds the order total". 4. Set a stop condition: "as soon as the criterion is met, stop; don't look for extra improvements". 5. Verify technical hints before putting them in the prompt: a wrong guess about the architecture is the most expensive thing of all — up to ×2.6 tokens wasted chasing a false lead.

Examples

[BAD]: `Explore several approaches to fixing the bug, compare the pros and cons, think carefully, and pick the best option.` [GOOD]: `Task: the calculate_discount() function returns a negative discount when the coupon is larger than the order total. Scope: change only the file discount.py, do not touch any other code. Done criterion: the test test_discount_negative passes and no other tests break. Stop condition: as soon as the tests pass, stop; do not look for alternative solutions.`

In plain words

Modern reasoning models like DeepSeek or Claude don't work like calculators — they're hyper-conscientious workers who take every word you say literally. When you ask them to "think harder" or "compare options," they don't just get smarter; they start churning out tons of hidden reasoning tokens. The problem is that these models often fall into a trap: they burn resources chewing over the obvious simply because that's how you phrased the task. That's pure waste — it bloats the context and your API bill but adds not one drop of quality to the final code.

It's like hiring a pricey lawyer who bills by the hour and asking them to "thoroughly analyze all the risks" in a contract to buy a loaf of bread. The lawyer will dutifully sit there for three hours, write ten pages and send you a $1,000 invoice, even though the answer was clear in a second. You made them fake a flurry of activity, and they did — technically you can't fault them, but in reality you just set money on fire.

The study pinned down the specific culprits behind this fiasco: phrases like "consider alternative approaches" or "analyze potential errors" on simple tasks act as triggers for junk reasoning. The model starts spinning its wheels inside its "head," generating 2-3x more hidden tokens than needed. Meanwhile accuracy doesn't go up — if the bug in the code is obvious, extra pondering won't fix it any better; it just makes the process pricier and slower.

The principle holds for any Reasoning Models (o1, DeepSeek-R1 and the rest). They were tested on coding, but the same nonsense happens when writing text, analyzing documents or planning. If the task is linear, any call for "deep analysis" becomes a stupidity tax. You pay for the model to retell the task to itself in different words while trying to satisfy your request for "complexity."

Bottom line: stop stuffing prompts with polite filler and "think twice" demands where everything is already clear. Extra instructions are extra money going down the drain with zero payoff. Write as dry and to-the-point as possible, or you risk getting a gold-plated answer to a nickel question. Whoever learns to shut down the model's inner monologue at the right moment will save budget and time while everyone else pays for its delusions of grandeur.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on "Compare several approaches": the phrase that makes AI coding agents burn 2-7x more tokens for nothing arXiv:2608.01347

Sign in to apply this study New accounts get 50 free credits.