Apply to my task
arXiv:2507.14239 ★ 73 Jul 17, 2025

XCoT — Let It Think in English, Get the Answer in Your Language

Key result

Asking an LLM a question in a lower-resource language wakes up a weaker copy of the model. The strong one lives in English: that's where most of the training data is, where the reasoning is most powerful, and where it makes things up least. XCoT lets you, with two lines in a prompt, switch the model into a mode of: reason in English, answer in your language. The trick: the language of reasoning doesn't have to match the language of the answer — that's the method's key insight. The model stops reaching for its thin knowledge base in your language and starts thinking where it's actually strong.

CCL-XCoT: An Efficient Cross-Lingual Knowledge Transfer Method for Mitigating Hallucination Generation

Key Aspects of the Study:

The study shows that multilingual large language models (MLLMs) "hallucinate" and produce wrong facts far more often when working in languages other than English (so-called "low-resource" languages). To fix this, the authors propose Cross-lingual Chain-of-Thought (XCoT), a method that makes the model first build a logical chain of reasoning in English and only then formulate the answer in the target language.

Key Result: Forcing an LLM to reason in English before answering in another language sharply reduces factual errors and fabrication.


The Core of the Method, Explained:

The method exploits the "language inequality" inside LLMs. Most models were trained on gigantic volumes of English text, which is why their ability to reason, check facts, and draw complex conclusions is strongest in English. When you ask a complex factual question in, say, Spanish or Tamil, the model tries to reason and phrase the answer simultaneously in that language, where its "knowledge base" and "reasoning machinery" are much weaker. That often leads to errors, guesswork, and hallucinations.

The XCoT (Cross-lingual Chain-of-Thought) method offers an elegant workaround. Instead of making the model do everything in a language that's "weak" for it, we split the process into two stages within one prompt:

  1. The reasoning stage (in the strong language): We tell the model directly: "First think step by step in English." At this stage, the model uses its powerful English-language "brain" to analyze the request, find relevant facts in its knowledge base, and build a correct chain of logic.
  2. The answer stage (in the target language): Once the right logic and facts are in place, we give a second command: "Now, based on your English reasoning, give the final answer in [the desired language]." For the model this is a much easier task — essentially "translating" a ready-made, verified, logical conclusion rather than generating it from scratch in a weak language.

So we use the model's strengths (reasoning in English) to make up for its weaknesses (thin knowledge and logic in other languages).


Practical Applicability Analysis:

  • Direct applicability: Maximum. Anyone working with an LLM in a language other than English can immediately improve answer quality by adding two simple instructions to their prompt: "First think in English" and "Then give the answer in [my language]." No special knowledge required.

  • Conceptual value: Enormous. Users stop seeing the LLM as a monolithic "all-knowing" entity and start understanding it as a system with distinct strengths and weaknesses. The key concept: the "language of reasoning" doesn't have to match the "language of the answer". That understanding opens the door to solving many problems with LLM accuracy and reliability in non-English contexts.

  • Adaptation potential: High. The principle of "using a stronger intermediate language/format for reasoning" can be adapted. For example, for complex technical or programming tasks, you can ask the model to first write a plan or pseudocode (a universal "language" of logic) and then write code in a specific programming language. For legal questions, first lay out the legal principles in English, then draft the contract clause in another language.


A Practical Example:

**Role:** You are an experienced dietitian and healthy-eating expert.

**Task:**
I need a detailed answer to the question: "What are the main long-term health risks of the keto diet?" The answer must be in Spanish, well structured, and understandable to someone without a medical background.

---

**INSTRUCTIONS:**

**Stage 1: Reason in English (Think in English)**
*   **Action:** First, break down the user's question. The key concepts are "keto diet", "long-term risks", and "health".
*   **Action:** Access your internal knowledge base about ketogenic diets. List the primary physiological changes it causes (ketosis, fat adaptation).
*   **Action:** Systematically list potential long-term risks based on scientific literature. Categorize them:
    1.  Cardiovascular risks (LDL cholesterol changes).
    2.  Kidney health (risk of kidney stones).
    3.  Nutrient deficiencies (lack of fiber, vitamins from fruits/grains).
    4.  Bone density issues.
    5.  Gut microbiome impact.
*   **Action:** For each risk, formulate a simple explanation of the mechanism. For example, for kidney stones, explain the role of hydration and changes in urine pH.
*   **Action:** Structure these points logically for a clear explanation.

**Stage 2: Final answer in Spanish**
*   **Action:** Based on your step-by-step reasoning in English, write a detailed, structured, clear answer in Spanish. Use subheadings for each risk. Avoid complex medical jargon.

Why It Works:

This prompt works by explicitly splitting a complex task into two stages that play to the LLM's strengths:

  1. Tapping the most reliable knowledge base: The vast majority of the medical and nutrition research the model was trained on is written in English. The Think in English instruction makes the model draw on this most complete and nuanced layer of data. That minimizes the risk of the model "filling in" facts based on thinner Spanish-language information.
  2. Structuring the logic: The step-by-step English instructions (Action: ...) work as Chain-of-Thought. The model doesn't just find facts; it builds a logical structure out of them: defines the key concepts, categorizes the risks, finds cause-and-effect links.
  3. Lowering the cognitive load: Once the logic and facts are gathered and checked in the model's "strong" language, the final task — presenting it in Spanish — becomes much simpler. It's no longer generation from scratch but more like a high-quality retelling or adaptation of finished material, which sharply lowers the chance of hallucinations.

Another Practical Example

**Role:** You are a financial advisor who specializes in personal investing for beginners.

**Task:**
Explain in plain words what "portfolio diversification" is and why it matters. Give a simple example for someone who wants to start investing with a small amount (say, $100). The answer must be in Spanish.

---

**TASK PROCESS:**

**STEP 1: Thinking and analysis in English (Reasoning in English)**
1.  **Define the core concept:** What is "portfolio diversification"? Explain it using the "don't put all your eggs in one basket" analogy.
2.  **Explain the "Why":** The main goal is risk management. Explain how different asset classes (stocks, bonds, etc.) react differently to market events. If one falls, another might rise or stay stable.
3.  **Create a simple example:** For a small sum like $100, think about accessible, low-cost instruments.
    *   Idea 1: A low-cost index fund (ETF) that already contains hundreds of stocks. This is instant diversification.
    *   Idea 2: A simple split: 60% into a broad stock market ETF, 30% into a bond ETF, 10% in a high-yield savings account (as cash equivalent).
4.  **Structure the final answer:** Plan to start with the analogy, then the formal explanation, then the importance (risk reduction), and finally the practical example.

**STEP 2: Writing the answer in Spanish**
*   Based on your analysis in English, provide a clear, easy-to-understand answer in Spanish. Follow the structure you developed in Step 1.

Why This Example Works.

This prompt is effective because it makes the model use its most developed "persona" — the English-speaking financial expert.

  1. Access to canonical knowledge: Financial theory, terminology, and popular analogies (like "don't put all your eggs in one basket") are canonical in English-language literature. The Reasoning in English request ensures the model goes to the original sources of these concepts rather than to possibly distorted or oversimplified translations.
  2. Practical relevance: When coming up with an example while reasoning in English, the model can work with global financial instruments (ETFs, index funds) that are the backbone of diversification. Then, at the Spanish answer stage, it adapts these universal concepts to local market realities (mentioning local currency and available instruments).
  3. Preventing "fluff" and errors: By making the model structure the answer plan first (Define -> Explain Why -> Example), we prevent a rambling stream of information. The model has to follow the logic, which makes the final Spanish answer not only factually accurate but also well organized and easy for a beginner to digest.

Usefulness Score: 88

02

Main Evaluation Criteria

  • A. Relevance to prompting techniques: High. The study proposes a concrete, reproducible prompt structure (XCoT — Cross-lingual Chain-of-Thought) that can be applied immediately.
  • B. Better conversational answers: Very high. The study's main goal is reducing hallucinations (by up to 62%) in answers in low-data languages, which directly improves accuracy and credibility.
  • C. Direct practical applicability: High. Part of the method (XCoT) requires no code or fine-tuning. Any user can build this logic into their prompt for ChatGPT, Claude, and other MLLMs.
  • D. Conceptual value: Very high. The study gives users a powerful mental model: an LLM "thinks" and reasons much better in a high-resource language (English). That explains why requests in other languages often lead to errors and provides the key to fixing the problem.
  • E. New useful practice: The paper falls into three clusters at once:
    • Cluster 1 (Prompt phrasing techniques): XCoT is a direct implementation of step-by-step thinking in a cross-lingual context.
    • Cluster 2 (LLM behavioral patterns): Clearly demonstrates the knowledge asymmetry between languages and that factual knowledge doesn't transfer automatically.
    • Cluster 7 (Reliability and stability): The method directly aims to reduce hallucinations and improve factual accuracy.
  • Practicality checklist (+15 points): Yes, the study provides ready-made structures, shows how to organize requests, and reveals non-obvious LLM behavior that can be used to improve accuracy.
03

Numeric Usefulness Score

Arguments for a high score (88/100): The study is a rare example of a scientific paper whose key finding (the XCoT method) can be applied immediately, with no technical skills, by any user of a multilingual LLM. The conceptual breakthrough for users is realizing that you can make the model "think" in its strongest language (English) while getting the answer in your native one, which dramatically improves the quality and reliability of the information. It solves one of the biggest problems for users outside the English-speaking world.

Counterarguments (why not 95-100): 1. Limited scope: The technique is most effective in a specific scenario: when a user asks a question in a language that's "low-resource" for the model and expects a factually accurate answer. For users who interact with LLMs exclusively in English, the technique is useless. 2. Effectiveness without fine-tuning: The method's maximum effectiveness (a 62% reduction in hallucinations) comes from combining prompting (XCoT) with special fine-tuning of the model (CCL). An everyday user can only apply the prompting part, so the real quality gain may be lower than the reported peak values, though still significant.


Research digest

Key result

Asking an LLM a question in a lower-resource language wakes up a weaker copy of the model. The strong one lives in English: that's where most of the training data is, where the reasoning is most powerful, and where it makes things up least. XCoT lets you, with two lines in a prompt, switch the model into a mode of: reason in English, answer in your language. The trick: the language of reasoning doesn't have to match the language of the answer — that's the method's key insight. The model stops reaching for its thin knowledge base in your language and starts thinking where it's actually strong.

Principle

The steps are simple: A → B → C. You ask a question in your language. You make the model break it down in English — step by step, with logic and facts. Then you ask it to state the conclusion in your language. At that last step, the model isn't generating an answer from scratch — it's retelling what it already built in the strong language. It's like telling a student interpreter: first get a handle on the subject in your native language, then present it to the client — instead of figuring it out and translating at the same time.

Why it works

LLMs were trained on enormous volumes of English text. Medicine, law, finance, science — all of it is primarily written in English. Data in most other languages is many times scarcer. When a model reasons directly in such a language, it leans on a thin base and starts filling the gaps with guesses. That's where hallucinations in non-English tasks come from — not an architecture flaw, just a shortage of examples for reasoning in that language. XCoT tackles the problem head-on: use the strong to make up for the weak.

When to apply

Works for any factual question in Chinese, Arabic, Tamil, Swahili — and other languages where the model has little data. Best effect on complex topics: medicine, history, law, technology. Especially useful when you need accuracy, not just smooth prose. Don't overcomplicate simple everyday requests — "write a birthday greeting" or "translate this word" don't need English reasoning.

Mini recipe

1. Add the first instruction: after describing the task, write "Step 1: Reason in English — break down the question, list the key facts, build the logic step by step." 2. Add the second instruction: "Step 2: Based on your reasoning, give the final answer in [your language]." 3. Want more control? Spell out the steps: `Action: define the key concept. Action: list main risks. Action: explain each mechanism.` — the model will follow the plan instead of improvising. 4. Check the result: is the answer more accurate? Did the vague "according to some experts" disappear? Then it worked.

Examples

[BAD]: `What are the long-term risks of the keto diet? Answer in Spanish.` [GOOD]: `Role: experienced dietitian. Task: explain the long-term risks of the keto diet to someone without a medical background. Step 1 — Reason in English: Action: Define ketogenic diet and how ketosis works. Action: List long-term health risks: cardiovascular, kidney stones, nutrient deficiencies, gut microbiome, bone density. Action: For each risk explain the mechanism in simple terms. Action: Structure the answer with clear categories. Step 2 — Give the answer in Spanish based on your reasoning. Use subheadings, avoid medical jargon.`

In plain words

When you ask a model to answer in a harder language for it — say, Spanish or Hindi — it often starts hallucinating, confidently spouting nonsense. The problem is that models' knowledge bases are mostly English, and when they try to deliver a result straight away in another language, the LLM's "brain" gets overloaded trying to think and translate at the same time. The CCL-XCoT method solves this with a division of labor: first the model reasons in its "native" English and builds a logical chain, and only then delivers a clean result in the language you need.

It's like asking a Chinese engineer to explain how a nuclear reactor works in broken English. They'll stumble and get the terms wrong simply because finding the words is hard for them. But if you let them first sketch the diagrams and calculations in Chinese and then carefully translate the finished plan, the result will be far more accurate. Same principle here: we make the AI first think in the language of knowledge and only then deal with the linguistics. Technically we just added an extra step, but in practice we saved the model from a logical meltdown.

At its core is the Cross-Lingual Chain-of-Thought method. Instead of diving in headfirst, the model takes two specific actions: a reasoning stage (Think in English), where it pulls facts about cholesterol, kidneys, and the microbiome out of memory, and a generation stage, where those facts get packaged into clear text in the target language. Research shows that this "buffer layer" cuts the amount of nonsense in answers, because the logical connections are built in the language the model trained on most.

This approach isn't just about diets or medicine — the principle is universal. Use it anywhere the cost of a mistake is high: programming, legal questions, or complex analytics. If you need an expert answer in Spanish, German, or Swahili, always make the model "think" in English first. SEO for meaning matters more than plain translation, and this method ensures facts don't get lost when moving from one language to another.

Long story short: if you want a solid AI answer in a language other than English, don't make it translate and think at the same time. Use a two-stage prompt structure so the model first gathers the facts in English and then hands you the finished product. It's simple insurance against the model inventing nonexistent diagnoses or laws just because it ran out of working memory for a quality translation. People who use this crutch get expert content; everyone else gets beautifully written misinformation.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on XCoT — Let It Think in English, Get the Answer in Your Language arXiv:2507.14239

Sign in to apply this study New accounts get 50 free credits.

Get the week’s best papers by email

One email on Sundays with the highest-rated new techniques. Unsubscribe with one click.