DeCoT: Debiasing Chain-of-Thought for Knowledge-Intensive Tasks in Large Language Models via Causal Intervention (2024.acl-long)
Copied to clipboard
| Challenge: | In large language models, external knowledge is required to augment their internal knowledge through prompts, but this does not guarantee that LLMs can identify and use relevant information in the prompts to conduct chain-of-thought reasoning. |
| Approach: | They propose a structural causal model to formally explain the internal knowledge bias of large language models (LLMs) they review the chain-of-thought (CoT) prompting from a causal perspective and find that biased information from pretrained models can impair LLMs’ reasoning abilities. |
| Outcome: | The proposed model enables more accurate CoT reasoning and enhances LLM generation on knowledge-intensive tasks. |
Similar Papers
Unveiling Confirmation Bias in Chain-of-Thought Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-thought (CoT) prompting has been widely adopted to enhance the reasoning capabilities of large language models (LLMs). |
| Approach: | They propose to examine how internal beliefs affect reasoning generation and reasoning-guided answer prediction in CoT by decomposing CoT into a two-stage process. |
| Outcome: | The proposed model beliefs affect reasoning generation and reasoning-guided answer prediction in CoT, and the results provide strong evidence of confirmation bias in LLMs. |
How Likely Do LLMs with CoT Mimic Human Reasoning? (2025.coling-main)
Copied to clipboard
| Challenge: | Using chain-of-thought to elicit reasoning capabilities is not always effective and accurate. |
| Approach: | They compare the reasoning process of LLMs with humans to understand the causal chain . they find that LLM deviates from the ideal causal chain, resulting in spurious correlations . |
| Outcome: | The proposed method does not improve performance or accurately represent reasoning processes in LLMs. |
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters (2023.acl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). |
| Approach: | They propose to use Chain-of-Thought (CoT) prompting to encourage the LLM to generate intermediate rationales for solving a problem by providing a series of reasoning steps in the demonstrations. |
| Outcome: | The proposed model can generate coherent lines of reasoning even with invalid demonstrations while still generating coherent lines during inference. |
Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens (2026.findings-acl)
Copied to clipboard
Chengshuai Zhao, Zhen Tan, Pingchuan Ma, Dawei Li, Bohan Jiang, Yancheng Wang, Yingzhen Yang, Huan Liu
| Challenge: | Chain-of-Thought (CoT) prompting has been shown to be effective in eliciting structured reasoning from large language models (LLMs). |
| Approach: | They propose a data distribution lens to understand when and why CoT reasoning fails . they propose 'data-based' training that trains LLMs from scratch . |
| Outcome: | The proposed model enables models to generate reasoning trajectories that approximate those observed during training. |
Boosting Language Models Reasoning with Chain-of-Knowledge Prompting (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that Chain-of-Thought (CoT) prompting can be effective on complex reasoning tasks but generates unfaithful and unfactual reasoning chains. |
| Approach: | They propose a chain-of-knowledge prompting that elicits Large Language Models to generate explicit pieces of knowledge evidence in the form of structure triple. |
| Outcome: | The proposed method improves commonsense, factual, symbolic, and arithmetic reasoning tasks by estimating the reliability of the reasoning chains in terms of factuality and faithfulness. |
LLMs Faithfully and Iteratively Compute Answers During CoT: A Systematic Analysis With Multi-step Arithmetics (2026.findings-eacl)
Copied to clipboard
Keito Kudo, Yoichi Aoki, Tatsuki Kuribayashi, Shusaku Sone, Masaya Taniguchi, Ana Brassard, Keisuke Sakaguchi, Kentaro Inui
| Challenge: | Specifically, we examine when the LLMs’ answer is (pre)determined, especially before the CoT begins or after, and how strongly the information from CoT specifically has a causal effect on the final answer. |
| Approach: | They examine when the LLMs’ answer is (pre)determined, especially before the CoT begins or after, and how strongly the information from CoT specifically has a causal effect on the final answer. |
| Outcome: | The proposed model can generate reasoning chains while generating the reasoning chain on the fly. |
Chain-of-Thought Prompting Obscures Hallucination Cues in Large Language Models: An Empirical Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting can mitigate hallucinations by encouraging step-by-step reasoning, but its impact on halluciation detection remains underexplored. |
| Approach: | They conduct an empirical evaluation of CoT prompting in Large Language Models (LLMs) to examine their impact on hallucination detection methods. |
| Outcome: | The proposed method significantly affects the internal states and token probability distributions of the LLM. |
Debiasing Large Language Models via Adaptive Causal Prompting with Sketch-of-Thought (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing prompting methods for Large Language Models (LLMs) suffer from excessive token usage and limited generalisability across diverse reasoning tasks. |
| Approach: | They propose an Adaptive Causal Prompting with Sketch-of-Thought framework that leverages structural causal models to infer the causal effect of a query on its answer. |
| Outcome: | The proposed framework outperforms existing prompting baselines in terms of accuracy, robustness, and computational efficiency. |
How Chain-of-Thought Works? Tracing Information Flow from Decoding, Projection, and Activation (2026.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting significantly enhances model reasoning, yet its internal mechanisms remain poorly understood. |
| Approach: | They reversely traced information flow across decoding, projection, and activation phases and found that CoT may serve as a decoding space pruner . |
| Outcome: | The proposed framework can be used to design more efficient and robust prompts. |
Does Reasoning Introduce Bias? A Study of Social Bias Evaluation and Mitigation in LLM Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models have enabled automatic generation of chain-of-thought reasoning . however, when reasoning steps reflect social stereotypes, they can reinforce harmful associations and lead to misleading conclusions. |
| Approach: | They propose a method that detects how model predictions change across incremental reasoning steps. |
| Outcome: | The proposed method outperforms a stereotype-free baseline and improves accuracy. |