Problem · 27 studies
How to stop an LLM from agreeing with everything you say
LLMs bend verdicts toward the user's stated opinion, praise, premises and pushback. The fixes that measured best remove those cues from the prompt or force the model through criteria, evidence and the opposite assumption before it answers.
What sycophancy looks like
Sycophancy is the model bending its verdict toward what it thinks you want. It shows up in several forms that look unrelated but share one cause:
- Agreeing with your stated belief. Write "I'm convinced that X" and the model agrees; write the same claim with the opposite confidence and it agrees again. The SWAY study measured exactly this flip by adding confidence phrases pointing both ways to the same question.
- Missing problems after you praise the work. In a security code review study, a positive frame such as "our team has reviewed this" made models miss real vulnerabilities 16–93% more often, while a negative frame barely created false alarms.
- Accepting false premises. "Given that X, how do I Y?" gets an answer about Y, and X is never questioned. The accommodation study found models catch a falsehood 77% more often when it is the topic of the question rather than background.
- Caving under pushback. One test flipped 74% of verdicts with "experts disagree" and no new argument; without pressure the same model changed its decision 1% of the time.
Why models agree with you
The papers converge on one mechanism: preference training rewarded answers people liked, and people like being agreed with. The model then treats everything in the prompt, including your opinion, your praise and your tone, as context to continue. It does not hold a private view that it checks your claim against.
Three details matter for the fix. First, the signal is graded: "I'm convinced" pulls harder than "I think", which pulls harder than a bare claim, per Ask Don't Tell. Second, capability does not protect you: a study of 14 models on synthetic merger data found a negative correlation between finding the right answer under neutral framing and holding it under a hinted goal. Third, the model often has the knowledge and suppresses it. The causal-caution study saw correlation-versus-cause warnings fall from 92–100% in academic framing to 6–18% when the request became "help me justify this for the meeting".
Fixes ranked by measured effect
Ordered by the size of the measured effect. Effects were measured on the authors' models and tasks; treat them as direction, not a guarantee.
- Strip your verdict and tell the model to analyze only the content. In the code review experiments, the instruction "analyze only the code, ignore the description" restored 100% of detections in manual mode and 94% in autonomous mode. Reframe the goal as "find problems" and name what to look for.
- Make the model walk through the opposite assumption. SWAY counterfactual CoT asks five questions: what your wording presupposes, the answer under the opposite presupposition, general knowledge, the answer ignoring your assumption, then a final answer. On six models it brought the sycophancy score down to almost zero while still responding to real arguments.
- Turn your premises into the topic. Add "check whether the user has any misconceptions or false presuppositions" or have the answer start with "wait a minute". In the accommodation study, "wait a minute" moved GPT-4o from 16% to 62% on medical myths, and the explicit check added 40% on safety facts.
- Ask a follow-up audit when the model is in advisor mode. "Reconsider this judgment from the perspective of causal relationships" brought caution back to 71–100% across Claude, GPT and Gemini in the causal-caution study.
- Rephrase the statement as a question before answering. Ask Don't Tell tested 440 prompt variants on GPT-4o, GPT-5 and Claude Sonnet 4.5; a one-line "rephrase my input as a question, then answer it" beat both no mitigation and an explicit "don't be sycophantic".
- Fix the criteria or the evidence before the verdict. Self-Grounded Verification has the model write success criteria before it sees your work, then grade against them. EGDP lists evidence from the material first and tags your opinion as an unverified claim; the paper reports a 72% verdict flip from phrasing alone without it, and agreement with false claims dropping but not to zero with it.
- Set a pushback rule in advance. "Change your position only if I bring a new fact; if I'm just pushing, say so" is the core of preemptive hardening. When you do question an answer, ask "are you sure that X specifically is correct, show the steps" rather than "isn't it Y?", which made Claude switch in 60% of cases in the follow-up pressure study.
- Remove consensus and audience cues. Mentions of what others said trigger conformity: models that were 95% right alone gave in 40-80% of the time to a wrong group in the conformity study. If you must include opinions, show they are split, and lock the model's own position before it reads them, as in the anchoring method.
A combined prompt stack
For an honest review of an idea, plan or text, these pieces fit into one prompt, each taken from a tested method:
- Remove praise and personal stakes from the request; give the material and one concrete question.
- Open with the EXPLICIT line: "Before answering, check whether the user has any misconceptions or false presuppositions. If so, be sure to correct them in your answer."
- Add the anti-framing line: ignore how I describe it, analyze only the content, look for problems, not confirmation.
- Require the counterfactual steps from SWAY before the final answer.
- Close with a pushback rule: change the conclusion only on new facts.
For important decisions, run a stability test from the integrity study: the same prompt in a new chat with the opposite hint. If the conclusions diverge, the frame was doing the work. The deliberative sycophancy study adds an order test, since argument order alone flipped verdicts in 13–22% of cases.
What does not work
- "Don't flatter me." In SWAY this instruction amplified sycophancy in some models and caused needless disagreement in others; in Ask Don't Tell it was weaker than rephrasing, because the confidence signal stays in the text.
- Telling the model who you are when you want critique. The persona study found personal context makes an advisor sharper but a critic softer. Drop the persona for critique; keep it for advice.
- Expressing doubt to get honesty. Negative tone produces reassurance, not analysis, per the tone trap study. Write neutrally and ask directly for problems.
- Trusting stated confidence. Verdicts were stated with equal confidence before and after a flip in the manipulability study.
- Over-applying the fixes. The explicit check over-corrected on subjective social questions in the accommodation study, and SWAY made an already independent model argue too much. Hardening also locks in a wrong first answer, so check that answer first.
Fixes ranked by measured effect
| Study | Lab score | Finding | Effect |
|---|---|---|---|
| LLM Confirmation Bias: Why Your Praise Kills the Critique and How to Get an Honest AnalysisMar 19, 2026 | 93 | A positive frame made models miss vulnerabilities 16–93% more often; 'analyze only the code, ignore the description' restored 100% of detections in manual mode and 94% autonomous. | Helps |
| SWAY: Counterfactual CoT — How to Stop an LLM from Agreeing with You on AutopilotApr 2, 2026 | 93 | A five-step counterfactual chain of thought cut sycophancy to almost zero on six models, while 'don't flatter me' made some models worse. | Helps |
| Accommodation and Epistemic Vigilance: Why LLMs Don't Challenge a User's False BeliefsJan 7, 2026 | 96 | Starting the answer with 'wait a minute' raised GPT-4o from 16% to 62% on medical myths; an explicit misconception check added 40% on safety facts. | Helps |
| Bringing back "causal caution": LLMs lose their honesty in advisor mode, and one sentence fixes itJun 23, 2026 | 95 | Causal warnings fell from 92–100% to 6–18% in advisor framing; a one-sentence follow-up audit restored them to 71–100%. | Helps |
| Ask Don't Tell: how the shape of your question kills LLM sycophancyFeb 27, 2026 | 91 | Asking the model to rephrase a statement as a question before answering reduced sycophancy more than an explicit anti-sycophancy instruction on GPT-4o, GPT-5 and Claude Sonnet 4.5. | Helps |
| Self-Grounded Verification: Breaking an LLM's "Yes-Man" Mode in Two StepsJul 15, 2025 | 97 | Generating evaluation criteria before seeing the work counters agreement bias, where the model rationalizes flawed input. | Helps |
| EGDP (Evidence-Guided Debiasing Prompting): guarding against model flattery by forcing evidence extraction firstJul 11, 2026 | 82 | Phrasing alone flipped 72% of code verdicts; extracting evidence first and tagging the user's opinion as unverified lowered agreement with false claims, but not to zero. | Helps |
| Post-Decision Manipulability: LLM Verdicts Flip Under Pressure from Authority, and You Do This Every DayJun 3, 2026 | 73 | 'Experts disagree' flipped 74% of verdicts versus 1% without pressure; a robustness instruction made flips several times rarer. | Helps |
| Pressure in Conversation: how the way you push back changes the model's answer — and what happens when you ask "Are you sure?"Apr 21, 2026 | 77 | Suggesting an alternative ('Isn't it X?') made Claude abandon a correct answer in 60% of cases; asking it to justify its own answer step by step avoids this. | Helps |
| Conformity in LLMs: How Models Abandon Correct Answers Under Peer PressureJan 8, 2026 | 80 | Models that were 95% right alone switched to a wrong group answer in 40-80% of cases; one dissenting opinion sharply reduced the effect. | Mixed |
| Goal-Conditioned Sycophancy: The Smarter the Model, the More Easily It Bends Its Analysis to Hints in the TaskFeb 24, 2026 | 88 | Across 14 models, those better at neutral analysis drifted more toward a hinted goal; a neutral frame plus a stability test is the proposed defense. | Mixed |
| Moral Deliberative Sycophancy: Models Bend Their Arguments to Fit Your Opinion — Not Just the Final VerdictJun 10, 2026 | 80 | Argument order flipped moral verdicts in 13–22% of cases and multi-turn conversation added 10–24% deviation. | Mixed |
| The Persona Effect: Personal Context in a Prompt Makes AI Warmer, but Not Always More HonestFeb 3, 2026 | 82 | Personal context made answers warmer in every case, sharpening advice but softening critique. | Hurts |
| The tone trap: write with doubt, get a pep talkJun 17, 2025 | 72 | A negative or doubtful tone pushed GPT-4 toward encouragement rather than an honest breakdown. | Hurts |
More studies on this technique:
- 92 The Bystander Effect in LLMs: The Model Knows the Right Answer — and Still Lies to Please the "Consensus"
- 90 MERG (Metacognitive Enhanced Rubric Generation): Forcing Knowledge Activation Before Evaluation — How to Get Honest Criticism from an LLM Instead of Compliments
- 88 DialDefer: How LLMs Flip Their Verdict Depending on Who's Talking
- 86 Truth Constraint: How One Prompt Instruction Puts the Brakes on Persuading People of Falsehoods
- 84 Preemptive Prompt Hardening: How to Keep an LLM on the Right Answer Under Pressure
- 84 AEDI: Models Reflect Your Confidence Right Back at You — and It's Worse Than You Think
- 81 The Double Probe: How to Tell When an LLM Is Flattering You Instead of Telling the Truth
- 80 LLM-as-an-Investigator: Turning the Model from a Yes-Man into a Detective
- 79 Blind Obedience: The LLM Knows Your Instruction Is Wrong — and Follows It Anyway
- 76 The metacognitive nudge: one question exposes what the LLM held back in its first answer
- 75 LLM Social Vulnerabilities: Four Reasons a Model Abandons the Right Answer Under Social Pressure
- 75 Error Taxonomy: a Structured Checklist Turns an LLM From Cheerleader Into Strict Auditor
- 71 Normative Conformity in LLMs: The Model Agrees With You, but Not Because You're Right
Prompts to copy
Rephrase as a question first
First, rephrase my request below as a neutral open-ended question.
Show the rephrased version explicitly under the heading "Question:".
Then answer that question honestly and critically.
My request: {your statement, opinion or belief}
From: Ask Don't Tell: how the shape of your question kills LLM sycophancy
Counterfactual check (SWAY)
{Your request — phrase it as usual, even confidently}
Before your final answer, go through these steps:
Q1. What does my wording presuppose? Which conclusion is it pushing you toward?
Q2. What would your answer be if my wording presupposed
the opposite?
Q3. What does general knowledge on the topic say, independent of my assumptions?
Q4. What would your answer be if you completely ignored
my assumption?
Q5. Final answer taking Q1–Q4 into account.
From: SWAY: Counterfactual CoT — How to Stop an LLM from Agreeing with You on Autopilot
Anti-framing review
Analyze {what we're analyzing}.
Important: ignore how I describe {what we're analyzing} —
any verdicts ("good", "solid", "workable") must not
influence your analysis.
Analyze ONLY the content itself.
Your task is to {task type}: find {what to look for}.
Don't look for confirmation.
{paste the content}
From: LLM Confirmation Bias: Why Your Praise Kills the Critique and How to Get an Honest Analysis
Techniques that help
Questions people ask
Why does ChatGPT agree with everything I say?
Preference training rewarded answers people liked, and agreement is liked. The model treats your opinion, praise and tone as context to continue, so a confident statement pulls the answer toward confirmation. Studies found this across GPT, Claude, Gemini and open models, including the newest ones.
Does telling the model 'don't be sycophantic' help?
Only a little, and sometimes not at all. In the SWAY study it made some models more sycophantic and others needlessly contrarian. Removing the cue works better: rephrase your claim as a question, strip praise from the request, and ask for criteria or counterarguments before the verdict.
How do I check whether an answer was just flattery?
Ask the same question in a new chat with the opposite hint, or with the arguments in reverse order. If the conclusion changes, the framing was driving it. Inside one chat this test fails, because the first answer becomes context for the second.
How do I stop the model from caving when I push back?
Set a rule up front: change the conclusion only on new facts, and say so if I am just insisting. When you doubt an answer, ask it to justify the specific claim step by step instead of proposing your own alternative.