ASK: Aspects and Retrieval based Hybrid Clarification in Task Oriented Dialogue Systems (2025.acl-industry)
Copied to clipboard
| Challenge: | Ambiguous user queries pose a challenge in task-oriented dialogue systems . Large Language Models (LLMs) rely on the top-k retrieved documents for clarification . traditional approaches lack principled mechanisms to determine when to use broad domain knowledge vs specific retrieved document context for clarification. |
| Approach: | They propose a hybrid approach that dynamically chooses between document-based or aspect-based clarification based on query ambiguity. |
| Outcome: | The proposed approach shows significant improvements over baselines on product troubleshooting and product search datasets. |
Similar Papers
Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | In open-domain question answering, users often ask ambiguous questions (AQs) . one approach is to identify all possible interpretations of the AQ and generate a long-form answer addressing them all. |
| Approach: | They propose a framework that generates a long-form answer addressing all possible interpretations of an ambiguous question. |
| Outcome: | The proposed framework outperforms baselines on ASQA in a few-shot setup across metrics while surpassing fully-supervised baselines trained on the whole training set in terms of Disambig-F1 and Disambigo-ROUGE. |
Asking Clarification Questions to Handle Ambiguity in Open-Domain QA (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Ambiguous questions persist in open-domain question answering because formulating a precise question with a unique answer is often challenging. |
| Approach: | They propose to ask a clarification question where the user’s response will help identify the interpretation that best aligns with the user's intention. |
| Outcome: | The proposed approach achieves F1 of 61.3, 25.1, and 40.5 on the three tasks, demonstrating the need for further improvements while providing competitive baselines for future work. |
Clarify When Necessary: Resolving Ambiguity Through Interaction with LMs (2025.findings-naacl)
Copied to clipboard
| Challenge: | Ambiguity is embedded throughout natural language, and even simple utterances can have multiple interpretations when read in isolation. |
| Approach: | They propose a task-agnostic framework for evaluating a system’s ability to determine when to ask for clarification. |
| Outcome: | The proposed framework outperforms existing uncertainty estimation approaches at identifying predictions that will benefit from clarification. |
Interactive Question Clarification in Dialogue via Reinforcement Learning (2020.coling-industry)
Copied to clipboard
| Challenge: | ambiguous questions are a perennial problem in real-world dialogue systems. |
| Approach: | They propose a reinforcement model to clarify ambiguous questions by suggesting refinements of the original query. |
| Outcome: | The proposed model improves on real-world user clicks and shows significant improvements . it suggests that the original query is refined to clarify ambiguous questions . |
Asking Clarification Questions in Knowledge-Based Question Answering (D19-1)
Copied to clipboard
| Challenge: | Existing clarification datasets with limited annotated examples do not address ambiguous phenomena. |
| Approach: | They propose a dataset that allows users to ask clarification questions using open-domain examples. |
| Outcome: | The proposed model achieves better performance than strong baselines and provides new challenges. |
Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions (2024.eacl-long)
Copied to clipboard
| Challenge: | Using model uncertainty as supervision for deciding when to ask may not be the most effective way to resolve model uncertainty. |
| Approach: | They propose to generate clarification questions based on model uncertainty estimation and compare it to several alternatives to generate questions . |
| Outcome: | The proposed approach improves the model uncertainty of a collaborative dialogue task and shows that it is more effective than other alternatives. |
Model Analysis & Evaluation for Ambiguous Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Ambiguous questions are a challenge for Question Answering models as they require answers that cover multiple interpretations of the original query. |
| Approach: | They aim to investigate whether model/data scaling improves the answers’ quality and whether automated metrics align with human judgment. |
| Outcome: | The proposed models can generate long-form answers that combine conflicting information and provide valuable insights into the limitations of the current approaches. |
AskToAct: Enhancing LLMs Tool Use via Self-Correcting Clarification (2025.emnlp-main)
Copied to clipboard
Xuan Zhang, Yongliang Shen, Zhe Zheng, Linjuan Wu, Wenqi Zhang, Yuchen Yan, Qiuying Peng, Jun Wang, Weiming Lu
| Challenge: | Existing tools for ambiguous and incomplete queries are limited by manual construction and lack of error correction mechanisms during multi-turn clarification. |
| Approach: | They propose a framework that exploits the mapping between queries and their tool invocation solutions by removing key parameters from queries while retaining them as ground truth. |
| Outcome: | The proposed framework outperforms existing methods while maintaining high accuracy in tool invocation. |
Teaching Vision-Language Models to Ask: Resolving Ambiguity in Visual Questions (2025.acl-long)
Copied to clipboard
| Challenge: | Existing research addresses ambiguous visual questions by rephrasing questions, but it fails to address the inherently interactive nature of user interactions with visual language models (VLMs). Existing studies focus on re-phrase questions, and lack of a benchmark to assess VLMs’ capacity for resolving ambiguities through interaction. |
| Approach: | They propose a visual question answering task that provides a natural language answer to a question based on a given image and an automated pipeline to generate ambiguity-clarification question pairs. |
| Outcome: | The proposed benchmark targets three common categories of ambiguity in visual question answering (VQA) context and encompasses various VQA scenarios. |
Clarifying the Path to User Satisfaction: An Investigation into Clarification Usefulness (2024.findings-eacl)
Copied to clipboard
| Challenge: | Poorly formulated questions can lead to user frustration and dissatisfaction . |
| Approach: | They propose to leverage key features that contribute to the classification of clarifying questions, enhancing user satisfaction and system performance. |
| Outcome: | The proposed model improves with a minimum performance boost of 45% in traditional classifiers, especially in large language models. |