From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models have shown impressive performance in various language tasks, but are prone to spurious correlations and illusory information. |
| Approach: | They propose to use pre-trained language models to justify decisions with formalized, coherent reasoning chains. |
| Outcome: | The proposed strategies improve coherence of rationalizations yielding state-of-the-art results on Tiered Reasoning for Intuitive Physics (TRIP). |
Similar Papers
Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale, pre-trained language models (LMs) have achieved human-level performance on a breadth of language understanding tasks. |
| Approach: | They propose a commonsense reasoning dataset with dense annotations that allows multi-tiered evaluation of machines’ reasoning process. |
| Outcome: | The proposed model can achieve high end performance but struggle to support predictions with valid supporting evidence. |
First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning (2024.emnlp-main)
Copied to clipboard
Yoichi Aoki, Keito Kudo, Tatsuki Kuribayashi, Shusaku Sone, Masaya Taniguchi, Keisuke Sakaguchi, Kentaro Inui
| Challenge: | Explicit multi-step reasoning is widely adopted to improve the performance of language models. |
| Approach: | They propose a systematic reasoning strategy that LMs use to solve multi-step reasoning tasks. |
| Outcome: | The proposed strategy improves the performance of language models by combining heuristics with rational strategies. |
Complex Reasoning in Natural Language (2023.acl-tutorials)
Copied to clipboard
| Challenge: | Recent research shows that pretrained language models are often brittle for complex reasoning tasks. |
| Approach: | They propose to use pre-trained language models to teach machines to reason over texts . they will review recent promising approaches to tackling complex reasoning tasks . |
| Outcome: | This tutorial reviews promising approaches to complex reasoning tasks . it reviews the methods that can be used to augment models with robustness . |
Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMs (2025.emnlp-main)
Copied to clipboard
Dayu Yang, Tianyang Liu, Daoan Zhang, Antoine Simoulin, Xiaoyi Liu, Yuwei Cao, Zhaopu Teng, Xin Qian, Grey Yang, Jiebo Luo, Julian McAuley
| Challenge: | Recent breakthrough models like OpenAI-o1 and DeepSeek-R1 show powerful task-solving capabilities, particularly advances in reasoning. |
| Approach: | They propose future research directions that may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence. |
| Outcome: | The proposed research may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence. |
Development of Cognitive Intelligence in Pre-trained Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show evidence for emergent cognitive abilities in Large Pre-trained Language Models (PLMs). Prior research into emergental cognitive abilities of PLMs has been path-independent to model training. |
| Approach: | They use four task categories to examine the alignment of ten popular families of PLMs and evaluate their performance to the developmental trajectories of children's thinking. |
| Outcome: | The results show that the models are more aligned to children's thinking than previous studies. |
Diffuse Thinking: Exploring Diffusion Language Models as Efficient Thought Proposers for Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated strong capabilities in complex reasoning tasks, yet their autoregressive generation paradigm makes it computationally prohibitive to explore diverse reasoning paths. |
| Approach: | They propose a framework that combines diffusion-based generation with autoregressive evaluation to efficiently generate diverse intermediate reasoning thoughts and employ LLMs as evaluators to assess and select candidates based on their plausibility and correctness. |
| Outcome: | The proposed framework improves inference efficiency while maintaining competitive or superior reasoning accuracy. |
A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences (2024.emnlp-main)
Copied to clipboard
| Challenge: | syllogistic reasoning is a deductive reasoning skill that is crucial in everyday problem-solving and decision-making experiences. |
| Approach: | They propose to study the reasoning abilities of Large Language Models (LLMs) they propose to use supervised fine-tuning and chain-of-thought reasoning to investigate their results. |
| Outcome: | The proposed models exhibit reasoning biases, avoid answering that no conclusion follows, align with human difficulties, and struggle with multi-step reasoning. |
Explain Yourself! Leveraging Language Models for Commonsense Reasoning (P19-1)
Copied to clipboard
| Challenge: | Empirical results indicate that we can effectively leverage language models for commonsense reasoning. |
| Approach: | They propose to use commonsense auto-generated explanations to train language models to generate explanations that can be used during training and inference in a commonsensense Auto-Generated Explanation framework. |
| Outcome: | Empirical results show that the proposed framework improves on the commonsenseQA task by 10%. |
How Likely Do LLMs with CoT Mimic Human Reasoning? (2025.coling-main)
Copied to clipboard
| Challenge: | Using chain-of-thought to elicit reasoning capabilities is not always effective and accurate. |
| Approach: | They compare the reasoning process of LLMs with humans to understand the causal chain . they find that LLM deviates from the ideal causal chain, resulting in spurious correlations . |
| Outcome: | The proposed method does not improve performance or accurately represent reasoning processes in LLMs. |
Stepwise Informativeness Search for Improving LLM Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have improved multistep reasoning but they lose focus over the middle of long contexts. |
| Approach: | They propose a tree search framework that proactively identifies underutilized steps and minimizing redundant information between steps. |
| Outcome: | The proposed framework generates more accurate and concise rationales with reduced errors and redundancy. |