CoAT: Chain-of-Associated-Thoughts Framework for Enhancing Large Language Models Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | OpenAI-o1 enables ‘slow thinking’ because it is closer to the human thought process . |
| Approach: | They propose a new framework that integrates the Monte Carlo Tree Search algorithm and a dynamic mechanism for integrating new key information, termed ‘associative memory’. |
| Outcome: | The proposed framework improves performance on open-source multi-hop reasoning datasets and more than 15% gain on proprietary CRB dataset. |
Similar Papers
Think Faster Than Words: Efficient LLM Chain-of-Thought Reasoning via Dynamic Shortcut Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods that prune or employ early stopping to reduce latency often compromise reasoning reliability. |
| Approach: | They propose a shortcut decoding framework that integrates probes over internal hidden states with step-level entropy to detect convergence of reasoning during generation and adaptively selects between a fast-exit path and a stability-verified path to remove redundant steps while preserving answer correctness. |
| Outcome: | The proposed framework reduces token usage by approximately 35% and maintains accuracy comparable to full CoT decoding. |
Chain-in-Tree: Back to Sequential Reasoning in LLM Tree Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models excel at tasks such as mathematical and commonsense reasoning, but their performance improves further when additional test-time compute is allocated. |
| Approach: | They propose a plug-in framework that decides when to branch during search instead of expanding at every step. |
| Outcome: | The proposed framework reduces token generation, model calls, and runtime by 75-85% on GSM8K and Math500, with negligible or no accuracy loss. |
Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs (2024.findings-acl)
Copied to clipboard
Bowen Jin, Chulin Xie, Jiawei Zhang, Kashob Kumar Roy, Yu Zhang, Zheng Li, Ruirui Li, Xianfeng Tang, Suhang Wang, Yu Meng, Jiawei Han
| Challenge: | Existing studies suggest augmenting LLMs with external text corpora to alleviate hallucination problems. |
| Approach: | They propose to augment large language models with text units retrieved from external knowledge corpora to alleviate the issue. |
| Outcome: | The proposed framework outperforms baselines on GRBench with three LLMs and shows that iterative reasoning outperformed the baselines. |
CoT-RAG: Integrating Chain of Thought and Retrieval-Augmented Generation to Enhance Reasoning in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Feiyang Li, Peng Fang, Zhan Shi, Arijit Khan, Fang Wang, Weihao Wang, null Zhangxin-hw, Cui Yongjian
| Challenge: | Chain-of-thought reasoning has two key limitations: lack of reliability when solely relying on LLM-generated reasoning chains and interference from natural language reasoning steps with the models’ inference logic. |
| Approach: | They propose a chain-of-thought reasoning framework with three key designs to address these issues. |
| Outcome: | The proposed framework improves the performance of large language models on complex tasks by incorporating knowledge graphs and learnable knowledge case-aware RAG. |
Android in the Zoo: Chain-of-Action-Thought for GUI Agents (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on large language models (LLMs) focus on the semantics of smartphone operations. |
| Approach: | They propose a large language model (LLM) which predicts a sequence of actions of API by analyzing past actions and visual observations. |
| Outcome: | The proposed model improves the prediction of actions on a zero-shot Android-In-The-Zoo dataset compared to previous models . |
ReKG-MCTS: Reinforcing LLM Reasoning on Knowledge Graphs via Training-Free Monte Carlo Tree Search (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to combining knowledge graphs with large language models face limitations in path exploration strategies or excessive computational overhead. |
| Approach: | They propose a training-free framework that synergizes Monte Carlo Tree Search with LLM capabilities to enable dynamic reasoning over KGs. |
| Outcome: | The proposed framework outperforms existing training-free methods and achieves competitive performance compared to fine-tuned baselines. |
SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to continuous-space reasoning focus on hard token decoding and suffer from catastrophic forgetting. |
| Approach: | They propose a method that generates instance-specific soft thought tokens as the initial chain of thoughts and maps them into the LLM’s representation space via a trainable projection module. |
| Outcome: | The proposed method improves LLM reasoning performance through supervised, parameter-efficient fine-tuning. |
MolRAG: Unlocking the Power of Large Language Models for Molecular Property Prediction (2025.acl-long)
Copied to clipboard
| Challenge: | Recent LLMs exhibit limited effectiveness on molecular property prediction task due to semantic gap between representations and natural language and lack of domain-specific knowledge. |
| Approach: | They propose a framework that integrates Chain-of-Thought reasoning for molecular property prediction. |
| Outcome: | The proposed framework outperforms pre-trained LLMs on four datasets and matches supervised methods. |
Recursion of Thought: A Divide-and-Conquer Approach to Multi-Context Reasoning with Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to generate intermediate steps (CoT) are limited by the maximum context size due to various reasons. |
| Approach: | They propose a new inference framework that introduces several special tokens that the models can output to trigger context-related operations. |
| Outcome: | Extensive experiments with multiple architectures including GPT-3 show that the proposed framework significantly improves LMs’ inference capability. |
Threading the Needle: Reweaving Chain-of-Thought Reasoning to Explain Human Label Variation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have shown the power of chain-of-thought reasoning in improving complex decision-making tasks. |
| Approach: | They propose a pipeline that generates chain-of-thought (CoT) explanations from CoTs with improved accuracy. |
| Outcome: | The proposed pipeline outperforms a direct generation method and baselines on three datasets. |