Empirical Investigation of Neural Symbolic Reasoning Strategies (2023.findings-eacl)
Copied to clipboard
Yoichi Aoki, Keito Kudo, Tatsuki Kuribayashi, Ana Brassard, Masashi Yoshikawa, Keisuke Sakaguchi, Kentaro Inui
| Challenge: | Neural reasoning accuracy improves when generating intermediate reasoning steps. |
| Approach: | They decompose the reasoning strategy w.r.t. step granularity and chaining strategy. |
| Outcome: | The proposed reasoning strategy significantly affects performance in a symbolic reasoning dataset. |
Similar Papers
Meta-Reasoning: Semantics-Symbol Deconstruction for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods rely on syntactically mapping natural languages to complete formal languages like Python and SQL. |
| Approach: | They propose to deconstruct reasoning-independent semantic information into generic symbolic representations, thereby efficiently capturing more generalized reasoning knowledge. |
| Outcome: | The proposed method improves in-context reasoning accuracy, learning efficiency, out-of-domain generalization, and output stability compared to the Chain-of thought technique. |
Adaptive LLM-Symbolic Reasoning via Dynamic Logical Solver Composition (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches to NLP are static and require manual formalization. |
| Approach: | They propose an adaptive, multi-paradigm, neuro-symbolic inference framework that automatically identifies formal reasoning strategies from problems expressed in natural language and dynamically selects and applies specialized formal logical solvers. |
| Outcome: | The proposed framework outperforms baselines on individual and multi-paradigm reasoning tasks by 17% and 6%. |
Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs (2025.findings-naacl)
Copied to clipboard
| Challenge: | a new framework for complex reasoning with LLMs is developed to improve reasoning proof accuracy and interpretability. |
| Approach: | They propose to use LLMs to generate search logs that can be interpreted into human-readable reasoning proofs. |
| Outcome: | The proposed framework improves reasoning accuracy but lacks interpretability due to black-box nature of the solvers. |
Training in Step-by-Step Formal Reasoning Improves Pronominal Reasoning in Language Models (2026.eacl-short)
Copied to clipboard
| Challenge: | Large reasoning models are limited to formal reasoning, i.e., math, code, and logic. |
| Approach: | They evaluate a set of large reasoning models on a dataset for pronoun resolution and fidelity. |
| Outcome: | The results show that distilling step-by-step formal reasoning improves pronoun resolution and fidelity. |
Evaluating Step-by-Step Reasoning through Symbolic Verification (2024.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs) have shown remarkable reasoning performance using explanations or chain-of-thoughts (CoT)) for in-context learning. |
| Approach: | They propose to use symbolic examples to iteratively reason over symbolic examples and to recover Prolog’s backward chaining algorithm to iterate over KBs. |
| Outcome: | The proposed model performs better on length generalization benchmarks than CoT on explanations and chain-of-thoughts (CoT) tasks. |
Verifying the Steps of Deductive Reasoning Chains (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models have been shown to improve the reasoning capabilities of the models. |
| Approach: | They propose to automate verification of individual reasoning steps in a logical deductive Chain-of-Thought. |
| Outcome: | The proposed method can detect unsound reasoning steps fairly well, but under-performs symbolic methods. |
Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent research indicates that Large Reasoning Models suffer from a strategic bottleneck at reasoning path planning. |
| Approach: | They propose a framework that reformulates reasoning as a dynamic search for the optimal thinking strategy. |
| Outcome: | The proposed framework improves accuracy and computational cost while reducing generation length by over 22%. |
Testing the limits of logical reasoning in neural and hybrid models (2024.findings-naacl)
Copied to clipboard
| Challenge: | despite the successes of deep learning models, we still need to know more about how and what they learn. |
| Approach: | They create tests to analyze logical reasoning patterns in neural and hybrid models . they find that models can generalize logical thinking only to a limited degree . |
| Outcome: | The proposed models can capture elementary aspects of meaning but only to limited extent . authors say they need to understand how and what they learn . |
Understanding the Language Model to Solve the Symbolic Multi-Step Reasoning Problem from the Perspective of Buffer Mechanism (2025.findings-emnlp)
Copied to clipboard
Zhiwei Wang, Yunji Wang, Zhongwang Zhang, Zhangchen Zhou, Hui Jin, Tianyang Hu, Jiacheng Sun, Zhenguo Li, Yaoyu Zhang, Zhi-Qin John Xu
| Challenge: | Large language models struggle with complex reasoning tasks, such as mathematical problem-solving. |
| Approach: | They constructed a symbolic multi-step reasoning task to investigate the information propagation mechanisms in Transformer models when solving the task through direct answering and Chain-of-Thought (CoT) reasoning. |
| Outcome: | The proposed algorithm improves on 7 multi-step reasoning datasets, while introducing only 132 trainable parameters. |
MultiLogicNMR(er): A Benchmark and Neural-Symbolic Framework for Non-monotonic Reasoning with Multiple Extensions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Non-monotonic reasoning is widely used in daily life and legal reasoning. |
| Approach: | They propose a neural-symbolic framework for multi-extension NMR and propose to build two variants with more extensions or text diversity. |
| Outcome: | The proposed framework outperforms prompt-based methods and outperformed some fine-tuning methods. |