Found 7 of 526 papers
The paradox: The simpler each step of a decision, the more accurate the final choice. LLMs handle complex choices among many options poorly — too many factors at once. The model starts guessing from surface cues instead of analyzing systematically. Atomic Instructions lets you make an accurate choice among dozens of similar options (content format, type of logical fallacy, issue category). The trick: break a complex description into 3-5 binary questions with reference answers. The model answers simple yes/no questions and compares against the pattern — Claude improved accuracy from 42% to 63% on a 232-option classification.
The paradox: a system of 8 translator-and-critic agents lost to a single prompt with 6 examples. The Direct Judge method finds meaning loss in translated technical requirements — when "50 milliseconds" quietly turns into "50 microseconds" while the grammar stays flawless. The model receives both texts and 6 examples of different drift types in a single prompt — instead of a chain of translator, structure extraction, cross-check, and critique. Result: it beat all 6 architectures, including a full multi-agent system.
The paradox: everyone chases prompting techniques (personas like "you are a psychologist," chains of reasoning), but what really matters is the task definition. The gap between "find gratitude" and a precise definition of what gratitude is = 75% accuracy. Adding "you are an expert" or "let's go step by step" to a bad prompt = +2-5%. On a good prompt these techniques add nothing at all. The method lets you build classification prompts that work an order of magnitude better by iterating over wordings of the definition. The trick: write 5-10 versions of the construct definition by hand → test them on labeled data → take the best one and ask the model to generate 10 more variants → test again → the winner + 3-5 examples with answers. You can't predict the best wording in advance — only empirically.
The paradox: 61% of the time, experts preferred LLM codes over those from human analysts — but only when the methodology was built right into the prompt. The method lets you analyze interviews, reviews, and open-ended answers with professional rigor: find patterns, create codes, group themes — the way a qualitative analysis expert does. The trick: a self-check before output. The model gets an expert role, a research question (RQ), and quality criteria from thematic analysis. Before output it grades itself: "Is the code specific? Does it help answer the RQ?" — if not, it redoes it. Result: codes that are crisper and more specific than the human ones.
The finding: GPT-5 agrees with itself more strongly than two human researchers agree with each other on the same survey. The four-prompt method lets you turn hundreds of open-ended answers into categories and themes without a predefined coding scheme: the model derives the structure from the text itself, the way a researcher does in qualitative analysis. The trick is to split "come up with categories" and "sort into categories" into two separate requests, so the model doesn't juggle creation and application at once. But the higher the level of generalization (from specific categories to big themes), the more the result diverges from human logic.
The finding: it's not just WHICH examples you give the model, it's WHERE they sit in the prompt. The method gets you stable, accurate answers from example-based prompts just by changing the structure of the request, without touching the content. Examples first, question last: the model first "tunes in" to the format and logic you want, then tackles the task. Examples placed after the question throw the model off, and answers become unpredictable and less accurate.
The more a model "thinks", the worse the summary. Reasoning models (specially trained for step-by-step reasoning) lose to plain GPT-4o at dialogue summarization: more fluff, more factual errors, a weaker grasp of the gist. The "Direct Request" method gets you accurate, short digests with no retelling and no extra words. Strip every "think step by step" out of the prompt and ask for the result right away: this activates synthesis mode instead of retelling mode. It works in any chatbot with no setup at all.