Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Study (D19-1)
Copied to clipboard
| Challenge: | Existing semantic parsing technologies are not well-suited for use in real-world applications. |
| Approach: | They propose a model-based intelligent agent that generates a clarification question in natural language . they propose 'interactive semantic parsing' with a human user in the loop . |
| Outcome: | The proposed approach improves both parsing accuracy and user confidence . it is demonstrated on two text-to-SQL datasets with different state-of-the-art parsers . |
Similar Papers
Towards Transparent Interactive Semantic Parsing via Step-by-Step Correction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on semantic parsing focus on mapping a natural-language utterance to a logical form (LF) but natural language may contain ambiguity and variability, making this challenge difficult. |
| Approach: | They propose an interactive semantic parsing framework that explains the predicted LF step by step in natural language and enables the user to make corrections through natural-language feedback for individual steps. |
| Outcome: | The proposed framework improves parsing accuracy and transparency in a crowdsourced dialogue dataset. |
NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction (2021.naacl-main)
Copied to clipboard
Ahmed Elgohary, Christopher Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Hassan Awadallah
| Challenge: | Existing systems frame semantic parsing as a one-shot translation from a natural language question to the logical form. |
| Approach: | They propose a model that uses natural language feedback to correct parsers . they show that NL-EDIT can boost the accuracy of existing parser by 20% . |
| Outcome: | The proposed model can boost parsers' accuracy by 20% with just one turn of correction. |
Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work on interactive semantic parsing relies on human annotations to train a model . prior work relied on human-annotated feedback data, which is prohibitively expensive and not scalable . |
| Approach: | They propose a task of simulating NL feedback for interactive semantic parsing . they propose evaluators to assess the quality of the simulated feedback . |
| Outcome: | The proposed simulator can generate high-quality NL feedback to boost the error correction ability of a specific parser. |
Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedback (2020.acl-main)
Copied to clipboard
| Challenge: | a natural language interface (NLI) can be used to correct semantic parsing errors . human correction accuracy is 81.5%, but the best model achieves only 25.1% . |
| Approach: | They propose a task where humans can provide free-form natural language feedback to correct a system when it generates an inaccurate interpretation of an initial utterance. |
| Outcome: | The proposed model improves the parsing accuracy while maintaining flexibility of natural language interaction. |
Global Reasoning over Database Structures for Text-to-SQL Parsing (D19-1)
Copied to clipboard
| Challenge: | Existing semantic parsers only select a set of database constants at training time . current models only consider local information, not global ones . |
| Approach: | They propose a semantic parser that globally reasons about the structure of the query to make a more contextually-informed selection of database constants. |
| Outcome: | The proposed model increases accuracy from 39.4% to 47.4% on a zero-shot semantic parsing dataset with complex databases. |
QASem Parsing: Text-to-text Modeling of QA-based Semantics (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work suggests the appeals of incorporating explicit semantic representations into NLP . semi-structured natural language structures provide an intermediate meaning-capturing representation . |
| Approach: | They propose a semi-structured natural-language representation of textual information . they examine input and output linearization strategies and multitask learning . |
| Outcome: | The proposed model is based on pre-trained sequence-to-sequence language models . it is easy to use and can be used for downstream tasks that benefit from it . |
Uni-Parser: Unified Semantic Parser for Question Answering on Knowledge Base and Database (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches on semantic parsing suffer from exponential growth of logical form candidates and can hardly generalize to unseen data. |
| Approach: | They propose a unified semantic parser for question answering on KB and DB . they define the primitive as the essential element in their framework . |
| Outcome: | The proposed framework can predict logical forms by altering and composing top-ranked primitives with different operations. |
An Imitation Game for Learning Semantic Parsers from User Interaction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for learning semantic parsers are expensive and tedious . despite the widespread applications, bootstrapping and fine-tuning is tedious a task . |
| Approach: | They propose an alternative method for learning semantic parsers directly from users . they propose an annotation-efficient imitation learning algorithm that iteratively collects new datasets . |
| Outcome: | The proposed method is cost-effective and shows promising performance on the text-to-SQL problem. |
Improving Text-to-SQL Semantic Parsing with Fine-grained Query Understanding (2022.emnlp-industry)
Copied to clipboard
Jun Wang, Patrick Ng, Alexander Hanbo Li, Jiarong Jiang, Zhiguo Wang, Bing Xiang, Ramesh Nallapati, Sudipta Sengupta
| Challenge: | Recent research on Text-to-SQL semantic parsing relies on parser or heuristic based approach to understand natural language query. |
| Approach: | They propose a general-purpose, modular neural semantic parsing framework that is based on token-level fine-grained query understanding. |
| Outcome: | The proposed framework outperforms the state-of-the-art model by 2.7% on a WikiTableQuestions test set. |
EUSP: An Easy-to-Use Semantic Parsing PlatForm (D19-3)
Copied to clipboard
| Challenge: | Semantic parsing aims to map natural language utterances into structured meaning representations. |
| Approach: | They propose a modular platform that allows developers to build semantic parser from scratch. |
| Outcome: | The proposed platform achieves competitive performance on semantic parsing task and improves performance of a business search engine. |