Disambiguate First, Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic Parsing (2025.findings-acl)
Copied to clipboard
| Challenge: | Natural language interfaces are often ambiguous, vague, or underspecified, giving rise to multiple valid interpretations. |
| Approach: | They propose a modular approach that resolves ambiguity using natural language interpretations before mapping them to logical forms. |
| Outcome: | The proposed approach improves interpretation coverage and generalizes across datasets with different annotation styles, database structures, and ambiguity types. |
Similar Papers
Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract Programs (D19-1)
Copied to clipboard
| Challenge: | Semantic parsing aims to map natural language utterances onto machine interpretable meaning representations. |
| Approach: | They propose to instill an inductive bias in the parser to help it distinguish between spurious and correct programs. |
| Outcome: | The proposed model is highly tractable on WikiTableQuestions and WikiSQL datasets. |
Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey (2025.emnlp-main)
Copied to clipboard
Mehrab Tanjim, Yeonjun In, Xiang Chen, Victor Bursztyn, Ryan A. Rossi, Sungchul Kim, Guang-Jie Ren, Vaishnavi Muppala, Shun Jiang, Yongsung Kim, Chanyoung Park
| Challenge: | Existing literature on ambiguity and disambiguation with Large Language Models (LLMs) ambiguities are a fundamental challenge in human-AI interactions due to complexity and flexibility of human language. |
| Approach: | They propose to define key terms and concepts and categorize various disambiguation approaches enabled by LLMs and provide a comparative analysis of their advantages and disadvantages. |
| Outcome: | The proposed frameworks are compared against different disambiguation approaches and highlight their relevance for future research. |
We’re Afraid Language Models Aren’t Modeling Ambiguity (2023.emnlp-main)
Copied to clipboard
Alisa Liu, Zhaofeng Wu, Julian Michael, Alane Suhr, Peter West, Alexander Koller, Swabha Swayamdipta, Noah Smith, Yejin Choi
| Challenge: | Ambiguity is an intrinsic feature of natural language, allowing us to anticipate misunderstandings and revise our interpretations as listeners. |
| Approach: | They use AmbiEnt to capture ambiguity in a sentence and analyze it to evaluate pretrained LMs. |
| Outcome: | The proposed model can flag political claims in the wild that are misleading due to ambiguity. |
Aligning Language Models to Explicitly Handle Ambiguity (2024.emnlp-main)
Copied to clipboard
Hyuhng Joon Kim, Youna Kim, Cheonbok Park, Junyeob Kim, Choonghyun Park, Kang Min Yoo, Sang-goo Lee, Taeuk Kim
| Challenge: | Large language models (LLMs) are not specifically trained to deal with ambiguous utterances . ambiguity can lead to varying interpretations of the same input based on different assumptions or background knowledge . |
| Approach: | They propose a pipeline that aligns large language models to manage ambiguous queries . they propose to use their own assessment of perceived ambiguity to detect and manage queries a . |
| Outcome: | Experimental results show that APA empowers LLMs to detect and manage ambiguous queries while retaining the ability to answer clear questions. |
Where do LLMs Encode the Knowledge to Assess the Ambiguity? (2025.coling-industry)
Copied to clipboard
| Challenge: | False sizing of large language models can generate unreliable responses . |
| Approach: | They propose a method to train large language models without ambiguity labels . |
| Outcome: | The proposed method detects ambiguous input prompts better than representations from the final layer. |
SQUAB: Evaluating LLM robustness to Ambiguous and Unanswerable Questions in Semantic Parsing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Practical user questions often deviate from ideal conditions, challenging the applicability of existing benchmarks. |
| Approach: | They propose an automatic dataset generator of Ambiguous and Unanswerable questions that generates complex, annotated SP tests using a blend of SQL and LLM capabilities. |
| Outcome: | The proposed framework reduces test generation costs by up to 99% while aligning with real-world question patterns. |
AmbigNLG: Addressing Task Ambiguity in Instruction for NLG (2024.emnlp-main)
Copied to clipboard
| Challenge: | AmbigNLG is a novel task designed to tackle task ambiguity in instructions for NLG . ambiguous instructions often impede the performance of Large Language Models (LLMs) . |
| Approach: | They propose an ambiguity taxonomy that categorizes different types of instruction ambiguities and refines initial instructions with clearer specifications. |
| Outcome: | The proposed task improves alignment of generated text with user expectations, achieving 15.02-point increase in ROUGE scores. |
Benchmarking and Improving Text-to-SQL Generation under Ambiguity (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing decoding algorithms treat SQL queries as a string and produce unhelpful token-level diversity in the top-k. |
| Approach: | They propose a benchmarking algorithm that generates all SQLs in top-k ranked outputs . they use plan-based template generation and constrained infilling to bridge this gap . |
| Outcome: | The proposed algorithm is 2.5 times more effective than state-of-the-art models at generating all candidate SQLs in the top-k ranked outputs. |
Incorporating Contextual Information for Language-Independent, Dynamic Disambiguation Tasks (L18-1)
Copied to clipboard
| Challenge: | a proposed multimodal system can resolve syntactic ambiguities by exploiting external evidence, says a researcher . a parser that processes linguistic information is expected to handle syntakically unambiguous sentences, but it cannot. |
| Approach: | They propose to exploit external contextual information to resolve ambiguous sentences . they propose to use data-driven and grammar-based approaches to solve ambiguities . |
| Outcome: | The proposed system confirms this hypothesis in experiments on syntactically ambiguous sentences. |
Reasoning about Ambiguous Definite Descriptions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing resources to evaluate reasoning are not well suited to investigate the capability of resolving ambiguities by explicit reasoning. |
| Approach: | They propose to use ambiguous definite descriptions to create a benchmark dataset which requires models to resolve ambiguity by explicit reasoning. |
| Outcome: | The proposed model includes all information required to resolve the ambiguity in the prompt, which means a model does not require anything but reasoning to do well. |