Logical Phase Transitions: Understanding Collapse in LLM Logical Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Symbolic logical reasoning is a critical yet underexplored capability of large language models (LLMs). |
| Approach: | They propose a framework that aligns natural language with logical symbols to establish a shared representation and reshapes training dynamics around phase-transition boundaries to progressively strengthen reasoning at increasing logical depths. |
| Outcome: | The proposed framework mitigates logical reasoning collapse at high complexity while improving generalization to unseen logical compositions. |
Similar Papers
Adaptive LLM-Symbolic Reasoning via Dynamic Logical Solver Composition (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches to NLP are static and require manual formalization. |
| Approach: | They propose an adaptive, multi-paradigm, neuro-symbolic inference framework that automatically identifies formal reasoning strategies from problems expressed in natural language and dynamically selects and applies specialized formal logical solvers. |
| Outcome: | The proposed framework outperforms baselines on individual and multi-paradigm reasoning tasks by 17% and 6%. |
ReEfBench: Quantifying the Reasoning Efficiency of LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Chain-of-Thought evaluations do not distinguish between genuine reasoning and mere verbosity. |
| Approach: | They propose a framework for the non-intrusive, comprehensive process-centric evaluation of reasoning grounded in First-Order Logic. |
| Outcome: | The proposed framework identifies four distinct behavioral prototypes and diagnoses the failure modes. |
Dissecting Failure Dynamics in Large Language Model Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models achieve strong performance through extended inference-time deliberation, yet how their reasoning failures arise remains poorly understood. |
| Approach: | They propose a framework that probes and redirects critical transitions using uncertainty signals. |
| Outcome: | Empirical evaluations show that GUARD improves reasoning performance . GUard probes critical transitions and redirects them using uncertainty signals . |
Where Reasoning Breaks: Logic-Aware Path Selection by Controlling Logical Connectives in LLMs Reasoning Chains (2026.findings-acl)
Copied to clipboard
| Challenge: | a single transition error can propagate through the entire reasoning chain, leading to unstable performance. |
| Approach: | They propose a framework that intervenes at logical connective junctions to improve LLMs' reasoning. |
| Outcome: | The proposed framework achieves favorable accuracy–efficiency trade-off compared to global inference time scaling methods like beam search and self-consistency. |
Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation (2026.findings-acl)
Copied to clipboard
Zhen Bi, Zhenlin Hu, Xueshu Chen, Mingyang Chen, Cheng Deng, Yida Xue, Zhen Wang, Qing Shen, Ningyu Zhang, Jungang Lou
| Challenge: | Existing data-centric paradigms equate quality with factuality or diversity and ignore the internal logical complexity of training samples. |
| Approach: | They propose a density-aware re-cognizing optimization strategy that prioritizes high-density logical samples to align training with the model's reasoning boundary. |
| Outcome: | The proposed metric outperforms existing methods and improves reasoning performance without increasing total data volume. |
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown human-like reasoning abilities but struggle with complex logical problems. |
| Approach: | They propose a framework which integrates large language models with symbolic solvers to improve logical problem-solving by combining them with a self-refinement module. |
| Outcome: | The proposed framework improves logical problem-solving by integrating LLMs with symbolic solvers. |
Reason from Fallacy: Enhancing Large Language Models’ Logical Reasoning through Logical Fallacy Understanding (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but struggle with some more complex reasoning tasks including logical reasoning. |
| Approach: | They propose five concrete tasks from three cognitive dimensions of WHAT, WHY, and HOW to evaluate LLMs’ capability of logical fallacy understanding. |
| Outcome: | The proposed dataset can be used to evaluate LLMs’ LFU capability and to fine-tune LLM models to obtain significantly enhanced performance on logical reasoning. |
Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study (2025.findings-emnlp)
Copied to clipboard
Yujun Zhou, Jiayi Ye, Zipeng Ling, Yufei Han, Yue Huang, Haomin Zhuang, Zhenwen Liang, Kehan Guo, Taicheng Guo, Xiangqi Wang, Xiangliang Zhang
| Challenge: | Existing benchmarks that rely on final-answer accuracy fail to capture the quality of the reasoning process. |
| Approach: | They propose a fine-grained evaluation framework that assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
| Outcome: | The proposed framework assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
Discovering a Shared Logical Subspace: Steering LLM Logical Reasoning via Alignment of Natural-Language and Symbolic Views (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multistep logical reasoning are limited by natural language refinement or external symbolic solvers. |
| Approach: | They propose a logical subspace that captures logical reasoning capabilities in LLMs that are shared across views while remaining independent of surface forms. |
| Outcome: | The proposed approach improves accuracy by 11 percentage points and generalizes well on out-of-domain problems. |
LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models (2024.acl-long)
Copied to clipboard
Mihir Parmar, Nisarg Patel, Neeraj Varshney, Mutsumi Nakamura, Man Luo, Santosh Mashetty, Arindam Mitra, Chitta Baral
| Challenge: | Existing work investigating the logical reasoning ability of large language models has focused only on a couple of inference rules of propositional and first-order logics. |
| Approach: | They propose to use a natural language question-answering dataset to evaluate the logical reasoning ability of large language models. |
| Outcome: | The proposed model performs poorly on a range of natural language questions using chain-of-thought prompting. |