| Challenge: | SymbCoT is a framework that integrates symbolic expressions and logic rules with CoT prompting. |
| Approach: | They propose a Symbolic Chain-of-Thought framework that integrates symbolic expressions and logic rules with CoT prompting. |
| Outcome: | The proposed framework improves on 5 standard datasets with symbolic expressions and rules . it shows that it is more faithful, flexible, and explainable than the current method . |
Similar Papers
SymBa: Symbolic Backward Chaining for Structured Natural Language Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Among different methods for structured reasoning, we focus on backward chaining, where the goal is recursively decomposed into subgoals by searching and applying rules. |
| Approach: | They propose a backward chaining system that integrates a symbolic solver and an LLM to improve the performance of LLM-based reasoning. |
| Outcome: | The proposed system improves deductive, relational, and arithmetic reasoning benchmarks compared to baselines. |
SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to continuous-space reasoning focus on hard token decoding and suffer from catastrophic forgetting. |
| Approach: | They propose a method that generates instance-specific soft thought tokens as the initial chain of thoughts and maps them into the LLM’s representation space via a trainable projection module. |
| Outcome: | The proposed method improves LLM reasoning performance through supervised, parameter-efficient fine-tuning. |
Logic-Thinker: Teaching Large Language Models to Think more Logically. (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent Large Reasoning Models (LRMs) have demonstrated the ability to generate long chains of thought (LongCoT) LongCoT still faces challenges such as redundancy and logical incoherence. |
| Approach: | They propose a neural-symbolic reasoning framework that generates chains of thought . they propose Logic-Thinker, which transforms symbolic solvers into chains of thoughts . |
| Outcome: | The proposed framework outperforms models fine-tuned with ThinkerCoT on logic reasoning tasks. |
Improving Chain-of-Thought Reasoning via Quasi-Symbolic Abstractions (2025.acl-long)
Copied to clipboard
| Challenge: | Recent work suggests using logical formalisms coupled with external symbolic solvers to solve complex tasks. |
| Approach: | They propose a framework to disentangle content from logical reasoning without a complete formalisation. |
| Outcome: | The proposed methods improve CoT-based methods by up to 8% accuracy on challenging adversarial variations on both natural language and symbolic reasoning tasks. |
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown human-like reasoning abilities but struggle with complex logical problems. |
| Approach: | They propose a framework which integrates large language models with symbolic solvers to improve logical problem-solving by combining them with a self-refinement module. |
| Outcome: | The proposed framework improves logical problem-solving by integrating LLMs with symbolic solvers. |
DiffCoT: Diffusion-styled Chain-of-Thought Reasoning in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but is vulnerable to exposure bias and error accumulation. |
| Approach: | They propose a diffusion-styled CoT framework that reformulates CoT reasoning as an iterative denoising process. |
| Outcome: | The proposed framework outperforms existing methods on three multi-step CoT reasoning benchmarks. |
Evaluating Step-by-Step Reasoning through Symbolic Verification (2024.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs) have shown remarkable reasoning performance using explanations or chain-of-thoughts (CoT)) for in-context learning. |
| Approach: | They propose to use symbolic examples to iteratively reason over symbolic examples and to recover Prolog’s backward chaining algorithm to iterate over KBs. |
| Outcome: | The proposed model performs better on length generalization benchmarks than CoT on explanations and chain-of-thoughts (CoT) tasks. |
Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketching (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have enabled strong reasoning capabilities through Chain-of-Thought (CoT) prompting. |
| Approach: | They propose a framework that integrates cognitively inspired reasoning paradigms with linguistic constraints to reduce token usage while preserving reasoning accuracy. |
| Outcome: | The proposed framework reduces token usage while preserving reasoning accuracy across 18 reasoning datasets across multiple domains, languages, and modalities. |
Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics (2025.findings-emnlp)
Copied to clipboard
Sheldon Yu, Yuxin Xiong, Junda Wu, Xintong Li, Tong Yu, Xiang Chen, Ritwik Sinha, Jingbo Shang, Julian McAuley
| Challenge: | Recent advances in chain-of-thought prompting have demonstrated the ability of large language models to perform multi-step reasoning. |
| Approach: | They propose a framework to analyze latent dynamics of CoT trajectories for interpretability . they segment generated CoT into discrete reasoning steps and abstract each step into a spectral embedding based on token-level Gram matrices . |
| Outcome: | The proposed framework segments generated CoT steps into discrete reasoning steps, abstracts each step into a spectral embedding based on token-level Gram matrices, and clusters these embeddements into semantically meaningful latent states. |
NSF-CoT: Neuro-Symbolic Formal Verification of Chain-of-Thought Faithfulness in Contextual Question Answering (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing faithfulness checks only test whether changing the written chain changes the answer, without verifying whether the steps are truly supported by the given evidence. |
| Approach: | They propose a method that checks CoT faithfulness step by step for contextual question answering. |
| Outcome: | The proposed method outperforms causal mediation, perturbation probes, and behavioral monitoring in OpenBookQA, QASC, and HotpotQA. |