ZEROTOP: Zero-Shot Task-Oriented Semantic Parsing using Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing LLMs cannot generalize to domain-specific parsing tasks in a zero-shot setting. |
| Approach: | They propose a task-oriented parsing method that decomposes parse problem into abstractive and extractive question-answering problems. |
| Outcome: | The proposed method decomposes a parsing problem into abstractive and extractive question-answering (QA) problems. |
Similar Papers
ZeLa: Advancing Zero-Shot Multilingual Semantic Parsing with Large Language Models and Chain-of-Thought Strategies (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to augment multilingual datasets with labeled English data are lacking in annotated data. |
| Approach: | They propose a framework to augment English data and then use it to train parsers . they propose to use multilingual chain-of-thought prompting techniques to augment other languages' data . |
| Outcome: | The proposed framework augments English data in other languages and trains them with no demonstration samples in target languages. |
Decoupling Structure and Lexicon for Zero-Shot Semantic Parsing (D18-1)
Copied to clipboard
| Challenge: | Existing methods for training semantic parsers in new domains require expensive supervision and lack the ability to generalize to new domain. |
| Approach: | They propose a zero-shot approach to parsing utterances in unseen domains . they map an utterant to an abstract, domain independent, logical form and replace slots with KB constants based on lexical alignment scores and global inference . |
| Outcome: | The proposed model achieves 53.4% accuracy on 7 domains in the OVERNIGHT dataset, significantly better than other zero-shot baselines and performs as good as a parser trained on over 30% of the target domain examples. |
On The Ingredients of an Effective Zero-shot Semantic Parser (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have performed zero-shot learning by synthesizing training examples of canonical utterances and programs from a grammar, and further paraphrasing these utterrances to improve linguistic diversity. |
| Approach: | They propose to bridge gaps between canonical and real-world user-issued examples by using stronger paraphrasers and improved grammars. |
| Outcome: | The proposed model achieves strong performance on two semantic parsing benchmarks with zero labeled data. |
Zero-Shot Semantic Parsing for Instructions (P19-1)
Copied to clipboard
| Challenge: | Recent years have seen an increasing number of applications that have a natural language interface, such as chatbots or "intelligent personal assistants" |
| Approach: | They propose a new training algorithm that trains a semantic parser on examples from a set of source domains and augment it with features and a logical form candidate filtering logic to support zero-shot adaptation. |
| Outcome: | The proposed framework performs better than a non-adapted parser with features and logical form candidate filtering logic. |
Constrained Language Models Yield Few-Shot Semantic Parsers (2021.emnlp-main)
Copied to clipboard
Richard Shin, Christopher Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Benjamin Van Durme
| Challenge: | Large pretrained language models excel at generating natural language, but they are not efficient for task specific semantic parsing. |
| Approach: | They propose to use large pretrained language models as few-shot semantic parsers . they paraphrase inputs into a controlled sublanguage resembling English . |
| Outcome: | The proposed model can generate surprisingly accurate models on multiple tasks with minimal code and data. |
Zero-Shot Cross-lingual Semantic Parsing (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work in cross-lingual semantic parsing assumes access to high-quality machine translation systems and word alignment tools. |
| Approach: | They propose a multi-task encoder-decoder model to transfer parsing knowledge to additional languages using only English-logical form paired data and in-domain natural language corpora. |
| Outcome: | The proposed model performs significantly above translation-based baselines and competes with the supervised upper-bound. |
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing language models can be refined for zero-shot commonsense reasoning . however, commons sense reasoning is still an unsolved problem . |
| Approach: | They propose a self-supervised learning approach that refines a pre-trained language model to boost conceptualization. |
| Outcome: | The proposed approach boosts conceptualization by utilizing loss landscape refinement. |
A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have enabled advances in the field of natural language processing . however, their application and potential are still underexplored . |
| Approach: | They evaluate four state-of-the-art instruction-tuned Large Language Models on 13 NLP tasks in English. |
| Outcome: | The evaluated models outperform state-of-the-art models on 13 real-world clinical and biomedical NLP tasks in English. |
ZeroDL: Zero-shot Distribution Learning for Text Clustering via Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown impressive performance on downstream tasks, but if they cannot be fully described in prompts, they could fail to perform the task. |
| Approach: | They propose a method to contextualize a task toward a large language model (LLM) they use open-ended zero-shot inference from the entire dataset to aggregate the inference results and incorporate the aggregated meta-information for the actual task. |
| Outcome: | The proposed method improves text clustering tasks and improves on several datasets. |
LLMs Are Zero-Shot Context-Aware Simultaneous Translators (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing SiMT systems operate on a sentence level, disregarding the context established by previous sentences or the broader context implied by previous words. |
| Approach: | They show that open-source LLMs perform on par with or better than some state-of-the-art baselines in simultaneous machine translation tasks, zero-shot. |
| Outcome: | The proposed models perform on par with or better than state-of-the-art baselines in simultaneous machine translation tasks, zero-shot. |