Priyanka Agrawal, Ayushi Dalmia, Parag Jain, Abhishek Bansal, Ashish Mittal, Karthik Sankaranarayanan
| Challenge: | Semantic parsing over multiple knowledge bases requires high-quality annotations of (utterance, program) pairs. |
| Approach: | They propose a framework to build a unified multi-domain enabled semantic parser with weak supervision. |
| Outcome: | The proposed model improves performance by 20% on the Overnight dataset. |
Similar Papers
Weakly Supervised Semantic Parsing with Abstract Examples (P18-1)
Copied to clipboard
| Challenge: | training semantic parsers from weak supervision complicates training in two ways . spurious programs that accidentally lead to a correct denotation add noise to training . |
| Approach: | They propose to use tokens in both language utterance and program to map denotations to executable programs. |
| Outcome: | The proposed method improves performance and reaches 82.5% accuracy compared to the best reported accuracy so far. |
Weakly Supervised Semantic Parsing with Execution-based Spurious Program Filtering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to train a semantic parser from weak supervision focus on exploiting similarities between examples based on domain-specific knowledge. |
| Approach: | They propose a domain-agnostic filtering mechanism based on program execution results to identify and filter out programs with significantly different semantics from the other programs. |
| Outcome: | The proposed method improves the performance of existing weakly-supervised parsers by incorporating a majority vote on the program search results. |
Denoising Multi-Source Weak Supervision for Neural Text Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have witnessed the rapid development of deep neural networks (DNNs) for text classification problems. |
| Approach: | They propose a label denoiser which estimates the source reliability using a conditional soft attention mechanism and reduces label noise by aggregating rule-annotated weak labels. |
| Outcome: | The proposed model outperforms state-of-the-art methods on sentiment, topic, and relation classifications and achieves comparable performance with fully-supervised methods even without labeled data. |
Open-world Multi-label Text Classification with Extremely Weak Supervision (2024.emnlp-main)
Copied to clipboard
| Challenge: | Similar single-label XWS settings cannot be easily adapted for multi-l label classification. |
| Approach: | They propose a novel method for open-world multi-label text classification under extremely weak supervision where the user provides a brief description without any labels or ground-truth label space. |
| Outcome: | The proposed method exhibits a remarkable increase in ground-truth label space coverage on various datasets. |
Learning from Executions for Semantic Parsing (2021.naacl-main)
Copied to clipboard
| Challenge: | Semantic parsing aims at translating natural language (NL) utterances onto machine-interpretable programs. |
| Approach: | They propose to encourage a parser to generate executable programs for unlabeled NL utterances. |
| Outcome: | The proposed training objectives outperform conventional methods on Overnight and GeoQuery. |
Enforcing Consistency in Weakly Supervised Semantic Parsing (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for training semantic parsers from only (utterance, denotation) supervision are challenging. |
| Approach: | They propose to use consistency between output programs for related inputs to reduce the impact of spurious programs. |
| Outcome: | The proposed formalisms improve model performance even without consistency-based training. |
Policy Shaping and Generalized Update Equations for Semantic Parsing from Denotations (D18-1)
Copied to clipboard
| Challenge: | Existing learning approaches for parsing from denotations (SpFD) do not provide access to correct representations, so there are two steps for every training example. |
| Approach: | They propose a framework for parsing from denotations that generalizes three different learning algorithms. |
| Outcome: | The proposed framework outperforms previous work by 5.0% absolute on exact match accuracy on a question answering dataset. |
Multitask Parsing Across Semantic Representations (P18-1)
Copied to clipboard
| Challenge: | UCCA parsing is a test case for multitask learning, with auxiliary tasks AMR, SDP and Universal Dependencies (UD) . Semantic parsers have arguably yet to reach their full potential due to the limited amount of semantically annotated training data. |
| Approach: | They propose a general transition-based parser that can parse UCCA, AMR, SDP and Universal Dependencies (UD) they use a transition-driven learning architecture and a uniform transition-basic learning architecture to train the parsers. |
| Outcome: | The proposed parser improves UCCA, AMR, SDP and Universal Dependencies (UD) parsing over training in English, German and French. |
Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract Programs (D19-1)
Copied to clipboard
| Challenge: | Semantic parsing aims to map natural language utterances onto machine interpretable meaning representations. |
| Approach: | They propose to instill an inductive bias in the parser to help it distinguish between spurious and correct programs. |
| Outcome: | The proposed model is highly tractable on WikiTableQuestions and WikiSQL datasets. |
USB: A Unified Summarization Benchmark Across Tasks and Domains (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing summarization benchmarks lack the rich annotations needed to address important problems related to control and reliability. |
| Approach: | They propose a Wikipedia-derived summarization benchmark with crowd-sourced annotations . they find that fine-tuned models outperform larger few-shot prompted language models . |
| Outcome: | The proposed model outperforms many-shot prompted language models on multiple tasks . the proposed model is based on Wikipedia annotations and can be used in other domains . |