Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have achieved great success in various NLP tasks, but the vast model parameters pose challenges in downstream fine-tuning. |
| Approach: | They propose a task-agnostic prompting strategy that analyzes each dialogue utterance before task execution to enhance LLMs' comprehension in multi-turn dialogues. |
| Outcome: | The proposed strategy outperforms other zero-shot prompts and matches or exceeds efficacy of few-shot ones. |
Similar Papers
Metacognitive Prompting Improves Understanding in Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in prompting have enhanced reasoning in logic-intensive tasks for LLMs, yet the nuanced understanding abilities of these models remain underexplored. |
| Approach: | They propose a strategy inspired by human introspective reasoning processes to enhance LLMs' understanding abilities. |
| Outcome: | The proposed method outperforms chain-of-thought prompting and its advanced versions on ten natural language understanding (NLU) datasets. |
How Interpretable are Reasoning Explanations from Prompting Large Language Models? (2024.findings-naacl)
Copied to clipboard
| Challenge: | Prompt Engineering has garnered significant attention for enhancing the performance of large language models across a multitude of tasks. |
| Approach: | They propose a simple prompting technique that yields more than 70% improvement in interpretability. |
| Outcome: | The proposed method improves interpretability by 70% across multiple dimensions. |
Frugal Prompting for Dialog Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are used in natural language processing tasks with an unrealistic speed and effectiveness. |
| Approach: | They propose more compact ways of providing dialog history information while ensuring good performance and reducing model’s inference-API costs. |
| Outcome: | The proposed models have the optimal usable-information density while maintaining good performance and reducing model’s inference-API costs. |
P3: Prompts Promote Prompting (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in prompt optimization have shown effectiveness of using multiple components to optimize models . however, such unilateral approaches often yield suboptimal results due to interdependent nature of these components. |
| Approach: | They propose a self-improvement framework that optimizes both system and user prompts . they use offline optimized prompts to promote online prompt optimization . |
| Outcome: | The proposed framework improves performance on general and reasoning tasks. |
Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for zero-shot Relation Extraction (RE) lack detailed, context-specific prompts for understanding various sentences and relations. |
| Approach: | They propose a framework that uses a three-stage diversity approach to prompt LLMs by generating multiple synthetic samples that encapsulate specific relations from scratch. |
| Outcome: | The proposed framework outperforms existing LLM-based zero-shot RE methods on benchmark datasets and shows that it produces high-quality synthetic data that enhances performance. |
An Adaptive Prompt Generation Framework for Task-oriented Dialogue System (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing black-box large language models (LLMs) have excellent performance in task-oriented dialogue (TOD) tasks, but obtaining suitable prompts for specific tasks is challenging. |
| Approach: | They propose a black-box large language model that generates domain and slot information in the belief state, which serves as prior knowledge for subsequent prompt generation. |
| Outcome: | The proposed framework outperforms existing prompting methods on the MultiWOZ 2.0 dataset. |
SEEval: Advancing LLM Text Evaluation Efficiency and Accuracy through Self-Explanation Prompting (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved remarkable success in various natural language generation tasks, but their performance in automatic text evaluation is not ready as human replacements. |
| Approach: | They propose a prompt-based text evaluator that incorporates self-explanation, a metacognitive strategy, to enhance automatic text evaluation. |
| Outcome: | The proposed method achieves competitive and often superior performance compared to the two state-of-the-art baselines – G-Eval and Analyze-Rate – and is 20 times more efficient in terms of run-time. |
Self-Prompting Large Language Models for Zero-Shot Open-Domain QA (2024.naacl-long)
Copied to clipboard
| Challenge: | Open-Domain Question Answering (ODQA) aims to answer questions without explicitly providing specific background documents. |
| Approach: | They propose a framework to explicitly utilize the massive knowledge encoded in LLM parameters and their strong instruction understanding abilities. |
| Outcome: | The proposed framework surpasses state-of-the-art methods on three widely-used ODQA datasets and achieves comparable performance with customized fine-tuned models on full training data. |
Re-Reading Improves Reasoning in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Unlike thought-eliciting prompting methods, RE2 shifts the focus to the input by processing questions twice, thereby enhancing the understanding process. |
| Approach: | They introduce a simple, yet general and effective prompting method, RE2, which rereads the question as input. |
| Outcome: | The proposed method demonstrates strong generality and compatibility with most thought-eliciting prompting methods, including CoT. |
Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that ChatGPT has limitations such as failing to ask clarifying questions to ambiguous queries or refusing problematic user requests. |
| Approach: | They propose a Proactive Chain-of-Thought prompting scheme which augments LLMs with the goal planning capability over descriptive reasoning chains to trigger proactivity. |
| Outcome: | The proposed scheme augments LLMs with the goal planning capability over descriptive reasoning chains to trigger the proactivity of LLM-based proactive dialogue systems. |