Challenge: Recent advances in large language models (LLMs) have achieved great success in various NLP tasks, but the vast model parameters pose challenges in downstream fine-tuning.
Approach: They propose a task-agnostic prompting strategy that analyzes each dialogue utterance before task execution to enhance LLMs' comprehension in multi-turn dialogues.
Outcome: The proposed strategy outperforms other zero-shot prompts and matches or exceeds efficacy of few-shot ones.

Similar Papers

Metacognitive Prompting Improves Understanding in Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in prompting have enhanced reasoning in logic-intensive tasks for LLMs, yet the nuanced understanding abilities of these models remain underexplored.
Approach: They propose a strategy inspired by human introspective reasoning processes to enhance LLMs' understanding abilities.
Outcome: The proposed method outperforms chain-of-thought prompting and its advanced versions on ten natural language understanding (NLU) datasets.
How Interpretable are Reasoning Explanations from Prompting Large Language Models? (2024.findings-naacl)

Copied to clipboard

Challenge: Prompt Engineering has garnered significant attention for enhancing the performance of large language models across a multitude of tasks.
Approach: They propose a simple prompting technique that yields more than 70% improvement in interpretability.
Outcome: The proposed method improves interpretability by 70% across multiple dimensions.
Frugal Prompting for Dialog Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) are used in natural language processing tasks with an unrealistic speed and effectiveness.
Approach: They propose more compact ways of providing dialog history information while ensuring good performance and reducing model’s inference-API costs.
Outcome: The proposed models have the optimal usable-information density while maintaining good performance and reducing model’s inference-API costs.
P3: Prompts Promote Prompting (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in prompt optimization have shown effectiveness of using multiple components to optimize models . however, such unilateral approaches often yield suboptimal results due to interdependent nature of these components.
Approach: They propose a self-improvement framework that optimizes both system and user prompts . they use offline optimized prompts to promote online prompt optimization .
Outcome: The proposed framework improves performance on general and reasoning tasks.
Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for zero-shot Relation Extraction (RE) lack detailed, context-specific prompts for understanding various sentences and relations.
Approach: They propose a framework that uses a three-stage diversity approach to prompt LLMs by generating multiple synthetic samples that encapsulate specific relations from scratch.
Outcome: The proposed framework outperforms existing LLM-based zero-shot RE methods on benchmark datasets and shows that it produces high-quality synthetic data that enhances performance.
An Adaptive Prompt Generation Framework for Task-oriented Dialogue System (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing black-box large language models (LLMs) have excellent performance in task-oriented dialogue (TOD) tasks, but obtaining suitable prompts for specific tasks is challenging.
Approach: They propose a black-box large language model that generates domain and slot information in the belief state, which serves as prior knowledge for subsequent prompt generation.
Outcome: The proposed framework outperforms existing prompting methods on the MultiWOZ 2.0 dataset.
SEEval: Advancing LLM Text Evaluation Efficiency and Accuracy through Self-Explanation Prompting (2025.findings-naacl)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved remarkable success in various natural language generation tasks, but their performance in automatic text evaluation is not ready as human replacements.
Approach: They propose a prompt-based text evaluator that incorporates self-explanation, a metacognitive strategy, to enhance automatic text evaluation.
Outcome: The proposed method achieves competitive and often superior performance compared to the two state-of-the-art baselines – G-Eval and Analyze-Rate – and is 20 times more efficient in terms of run-time.
Self-Prompting Large Language Models for Zero-Shot Open-Domain QA (2024.naacl-long)

Copied to clipboard

Challenge: Open-Domain Question Answering (ODQA) aims to answer questions without explicitly providing specific background documents.
Approach: They propose a framework to explicitly utilize the massive knowledge encoded in LLM parameters and their strong instruction understanding abilities.
Outcome: The proposed framework surpasses state-of-the-art methods on three widely-used ODQA datasets and achieves comparable performance with customized fine-tuned models on full training data.
Re-Reading Improves Reasoning in Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Unlike thought-eliciting prompting methods, RE2 shifts the focus to the input by processing questions twice, thereby enhancing the understanding process.
Approach: They introduce a simple, yet general and effective prompting method, RE2, which rereads the question as input.
Outcome: The proposed method demonstrates strong generality and compatibility with most thought-eliciting prompting methods, including CoT.
Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have shown that ChatGPT has limitations such as failing to ask clarifying questions to ambiguous queries or refusing problematic user requests.
Approach: They propose a Proactive Chain-of-Thought prompting scheme which augments LLMs with the goal planning capability over descriptive reasoning chains to trigger proactivity.
Outcome: The proposed scheme augments LLMs with the goal planning capability over descriptive reasoning chains to trigger the proactivity of LLM-based proactive dialogue systems.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations