Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation (2024.findings-acl)
Copied to clipboard
Ruomeng Ding, Chaoyun Zhang, Lu Wang, Yong Xu, Minghua Ma, Wei Zhang, Si Qin, Saravan Rajmohan, Qingwei Lin, Dongmei Zhang
| Challenge: | Recent advances in Large Language Models (LLMs) have greatly advanced problem solving in diverse domains such as mathematical reasoning and knowledge reasoning. |
| Approach: | They propose a thought prompting approach called 'Everything of Thoughts' it leverages pretrained reinforcement learning and Monte Carlo Tree Search to incorporate external domain knowledge and planning capability into thoughts. |
| Outcome: | The proposed approach outperforms existing approaches on game of 24, 8-Puzzle, and Pocket Cube. |
Similar Papers
Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketching (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have enabled strong reasoning capabilities through Chain-of-Thought (CoT) prompting. |
| Approach: | They propose a framework that integrates cognitively inspired reasoning paradigms with linguistic constraints to reduce token usage while preserving reasoning accuracy. |
| Outcome: | The proposed framework reduces token usage while preserving reasoning accuracy across 18 reasoning datasets across multiple domains, languages, and modalities. |
Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for large language models (LLMs) have been used to prompt different reasoning thoughts, such as Chain of Thought and Program of Though. |
| Approach: | They propose a framework that prompts large language models with diverse reasoning thoughts by iterating between different prompting methods. |
| Outcome: | The proposed framework is able to generate multiple reasoning thoughts in 10 popular math reasoning datasets and is orthogonal to recent work that makes improvements on single reasoning methods and can generalise to logical reasoning domain. |
SoT: Structured-of-Thought Prompting Guides Multilingual Reasoning in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models struggle with multilingual reasoning tasks due to resource constraints . a training-free method improves performance on multilingual thinking tasks . |
| Approach: | They propose a training-free method that transforms language-specific semantic information into language-agnostic structured representations. |
| Outcome: | The proposed method outperforms strong baselines on multilingual reasoning tasks. |
Let’s Be Self-generated via Step by Step: A Curriculum Learning Approach to Automated Reasoning with Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing efforts to improve CoT prompting have limitations that require extensive human effort or performance needs to be improved. |
| Approach: | They propose a prompt approach for automatic reasoning called LBS3 inspired by curriculum learning which better reflects human learning habits. |
| Outcome: | The proposed approach achieves strongly competitive performance compared to baselines in reasoning-intensive tasks with varying open- and closed-source LLMs. |
SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to continuous-space reasoning focus on hard token decoding and suffer from catastrophic forgetting. |
| Approach: | They propose a method that generates instance-specific soft thought tokens as the initial chain of thoughts and maps them into the LLM’s representation space via a trainable projection module. |
| Outcome: | The proposed method improves LLM reasoning performance through supervised, parameter-efficient fine-tuning. |
Markov Chain of Thought for Efficient Mathematical Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have sought to enhance the mathematical reasoning capabilities of large language models. |
| Approach: | They propose a Markov Chain of Thought (MCoT) that compresses previous reasoning steps into a simplified question. |
| Outcome: | The proposed method improves efficiency and maintains comparable accuracy. |
ThoughtSculpt: Reasoning with Intermediate Revision and Search (2025.findings-naacl)
Copied to clipboard
| Challenge: | THOUGHTSCULPT is a general reasoning and search method for tasks with outputs that can be decomposed into components. |
| Approach: | They propose a general reasoning and search method for tasks with outputs that can be decomposed into components. |
| Outcome: | THOUGHTSCULPT outperforms state-of-the-art reasoning methods on three tasks . authors show that distinct prompting strategies can influence the performance of LLMs . |
How Do Humans Write Code? Large Models Do It the Same Way Too (2024.emnlp-main)
Copied to clipboard
| Challenge: | Program-of-Thought (PoT) replaces natural language-based Chain-ofThough (CoT) but introduces more reasoning errors, such as incorrect formulas or flawed logic, compared to CoT. |
| Approach: | They propose a method that integrates CoT and Program-of-Thought to achieve more accurate reasoning and reinforcement learning. |
| Outcome: | The proposed method achieves an average improvement of 6.5% on the Llama-Base model and 4.3% on the Mistral-Bass model across 8 mathematical calculation datasets. |
EoT: Evolution of Thoughts for Complex Reasoning Tasks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on ensuring behavior fidelity, factuality or reliability in generated reasoning processes, but they neglect the simultaneous optimization of all three aspects for each thought. |
| Approach: | They propose a thought assessment method that is sensitive to knowledge and LLM behaviors . they use three scorers to evaluate each thought by considering domain context, semantic alignment, and behavior impact. |
| Outcome: | The proposed framework outperforms advanced approaches in knowledge-based complex tasks. |
Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs (2024.findings-acl)
Copied to clipboard
Bowen Jin, Chulin Xie, Jiawei Zhang, Kashob Kumar Roy, Yu Zhang, Zheng Li, Ruirui Li, Xianfeng Tang, Suhang Wang, Yu Meng, Jiawei Han
| Challenge: | Existing studies suggest augmenting LLMs with external text corpora to alleviate hallucination problems. |
| Approach: | They propose to augment large language models with text units retrieved from external knowledge corpora to alleviate the issue. |
| Outcome: | The proposed framework outperforms baselines on GRBench with three LLMs and shows that iterative reasoning outperformed the baselines. |