QDMR-based Planning-and-Solving Prompting for Complex Reasoning Tasks (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing Plan-and-Solve prompting methods are difficult to implement for complex questions. |
| Approach: | They propose a plan-and-solve prompting method based on Question Decomposition Meaning Representation (QDMR) it allows LLM to generate a QDMR graph to represent problem-solving logic . |
| Outcome: | The proposed method can represent and execute the problem-solving logic of complex questions more accurately than existing methods. |
Similar Papers
Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for question generation over knowledge bases rely on annotated data for fine-tuning . emergence of Large Language Models (LLMs) has shown impressive generalization ability in few-shot tasks. |
| Approach: | They propose to use a logical form to generate a question in a reasoning problem . they propose to extend the prompting method into a method that can generate questions in logical forms . |
| Outcome: | The proposed method outperforms baselines on three public KBQG datasets. |
Boosting Language Models Reasoning with Chain-of-Knowledge Prompting (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that Chain-of-Thought (CoT) prompting can be effective on complex reasoning tasks but generates unfaithful and unfactual reasoning chains. |
| Approach: | They propose a chain-of-knowledge prompting that elicits Large Language Models to generate explicit pieces of knowledge evidence in the form of structure triple. |
| Outcome: | The proposed method improves commonsense, factual, symbolic, and arithmetic reasoning tasks by estimating the reliability of the reasoning chains in terms of factuality and faithfulness. |
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. |
| Approach: | They propose a plan-and-solve (PS) prompting that includes a few manual steps to generate reasoning steps and improves the quality of generated reasoning steps. |
| Outcome: | The proposed strategy outperforms Zero-shot-CoT on ten reasoning problems and has comparable performance to 8-shot CoT prompting on the math reasoning problem. |
CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solving (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown great ability in solving traditional natural language tasks and elementary reasoning tasks with appropriate prompting techniques. |
| Approach: | They propose a collaborative multi-agent, multi-reasoning-path prompting framework that prompts LLMs to play different roles in a problem-solving team and encourages different role-play agents to collaboratively solve the target task. |
| Outcome: | The proposed framework is applied to two college-level science problems over competitive baselines. |
PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents (2024.eacl-long)
Copied to clipboard
| Challenge: | Using chain-of-thought prompting, large language models perform better on complex reasoning tasks. |
| Approach: | They propose a prompting framework that decomposes a question into a sequence of actions and executes them over the document to obtain the answer. |
| Outcome: | The proposed framework outperforms zero-shot and chain-of-thought prompting on a QuALITY dataset . it proposes a plan based on actions mined from a training set and executes it step by step . |
Question-Analysis Prompting Improves LLM Performance in Reasoning Tasks (2024.acl-srw)
Copied to clipboard
| Challenge: | Existing methods to improve LLM performance have focused on sophisticating the model's step-by-step calculation. |
| Approach: | They propose a question analysis prompting strategy in which the model is prompted to explain the question in 'n' words before solving. |
| Outcome: | The proposed prompt outperforms state-of-the-art prompts on arithmetic and commonsense datasets and consistently ranks among the top-2 prompts. |
Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models (2025.coling-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit impressive performance across various domains but struggle with arithmetic reasoning tasks. |
| Approach: | They propose a Teaching-Inspired Integrated Prompting Framework which emulates the instructional process of a teacher guiding students. |
| Outcome: | The proposed framework improves reasoning accuracy on nine benchmarks. |
Successive Prompting for Decomposing Complex Questions (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent work leverages the capabilities of large language models (LMs) to perform complex question answering in a few-shot setting by generating latent reasoning steps before answering the question. |
| Approach: | They propose a method to iteratively break down a complex task into a simple task, solve it, and repeat the process until we get the final solution. |
| Outcome: | The proposed model achieves an improvement in F1 of 5% when compared with a state-of-the-art model with synthetic augmentations and few-shot version of the DROP dataset. |
Metacognitive Prompting Improves Understanding in Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in prompting have enhanced reasoning in logic-intensive tasks for LLMs, yet the nuanced understanding abilities of these models remain underexplored. |
| Approach: | They propose a strategy inspired by human introspective reasoning processes to enhance LLMs' understanding abilities. |
| Outcome: | The proposed method outperforms chain-of-thought prompting and its advanced versions on ten natural language understanding (NLU) datasets. |
Iteratively Prompt Pre-trained Language Models for Chain of Thought (2022.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) internalize a great amount of knowledge, but have been shown incapable of recalling this knowledge to solve complex & multi-step reasoning tasks. |
| Approach: | They propose an iterative prompting framework which progressively elicits relevant knowledge from PLMs for multi-step inference. |
| Outcome: | The proposed prompting framework outperforms existing prompting methods on three datasets involving multi-step reasoning. |