Hierarchical Recurrent Aggregative Generation for Few-Shot NLG (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches do not account for the fact that some sub-tasks, specifically aggregation and lexicalisation, can benefit from transfer learning in different extents. |
| Approach: | They propose a hierarchical approach for few-shot and zero-shot generation using a three-moduled jointly trained architecture. |
| Outcome: | The proposed approach achieves state-of-the-art on few-shot and zero-shot settings compared to previous approaches. |
Similar Papers
Few-Shot NLG with Pre-Trained Language Model (2020.acl-main)
Copied to clipboard
| Challenge: | Neural-based approaches to natural language generation are data-hungry and difficult to adopt in real-world applications. |
| Approach: | They propose a task of few-shot natural language generation from structured data or knowledge to generate coherent sentences from input data and language modeling to compose coherent sentences. |
| Outcome: | The proposed approach outperforms the strongest baseline approach by over 8.0 BLEU points improvement. |
AugNLG: Few-shot Natural Language Generation using Self-trained Data Augmentation (2021.acl-long)
Copied to clipboard
| Challenge: | Large-scale conversational systems typically generate unnatural, robotic responses using template-based approaches. |
| Approach: | They propose a data augmentation approach that combines a self-trained neural retrieval model with a few-shot learned NLU model to automatically create MR-to-Text data from open-domain texts. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on the FewshotWOZ data in both BLEU and Slot Error Rate. |
Few-shot Table-to-text Generation with Prefix-Controlled Generator (2022.coling-1)
Copied to clipboard
| Challenge: | Neural table-to-text generation approaches are data-hungry and lack labeled data. |
| Approach: | They propose a prompt-based approach for few-shot table-to-text generation using a task-specific prefix and an input-specific input prefix. |
| Outcome: | The proposed approach is able to generate table-to-text summaries with a few instances and is validated on human, book and song datasets. |
Data Augmentation and Learned Layer Aggregation for Improved Multilingual Language Understanding in Dialogue (2022.findings-acl)
Copied to clipboard
| Challenge: | Multi-SentAugment and LayerAgg are self-training methods that augment available training data with similar (automatically labelled) in-domain sentences from large monolingual Web-scale corpora. |
| Approach: | They propose to use multi-sentaugment and layeragg to improve dialogue natural language understanding across multiple languages. |
| Outcome: | The proposed methods generalise well in zero- and few-shot scenarios and leverage external unannotated data sources. |
Few-Shot Data-to-Text Generation via Unified Representation and Multi-Source Learning (2023.acl-long)
Copied to clipboard
Alexander Hanbo Li, Mingyue Shang, Evangelia Spiliopoulou, Jie Ma, Patrick Ng, Zhiguo Wang, Bonan Min, William Yang Wang, Kathleen McKeown, Vittorio Castelli, Dan Roth, Bing Xiang
| Challenge: | Existing methods for data-to-text generation focus on specific types of structured data. |
| Approach: | They propose a method that provides a unified representation that can handle various forms of structured data such as tables, knowledge graph triples, and meaning representations. |
| Outcome: | The proposed method improves zero-shot and few-shot scenarios and can adapt to new structured data. |
SEQZERO: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent research shows promising results on combining pretrained language models with canonical utterance for few-shot semantic parsing. |
| Approach: | They propose a few-shot semantic parsing method that decomposes a problem into a sequence of sub-problems, which correspond to the sub-clauses of the formal language. |
| Outcome: | The proposed method achieves SOTA performance of BART-based models on GeoQuery and EcommerceQuery, which are two few-shot datasets with compositional data split. |
Selective Token Generation for Few-shot Natural Language Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed selective token generation algorithm outperforms the previous additive learning algorithms based on the PLMs. |
| Approach: | They propose an additive learning algorithm that selectively outputs language tokens between a task-general PLM and a specific adapter during training and inference. |
| Outcome: | The proposed algorithm outperforms existing methods on few-shot natural language generation tasks. |
Zero- and Few-Shot NLP with Pretrained Language Models (2022.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to introduce NLP researchers to the latest techniques for learning from little-to-no data . aims at bringing interested researchers up to speed about the latest and ongoing techniques . |
| Approach: | They aim to introduce techniques for learning from little-to-no data using pretrained language models. |
| Outcome: | This tutorial aims to bring interested NLP researchers up to speed about recent techniques . it will cover methods from manual engineering, better inference algorithms to better tuning methods . |
ZeroDL: Zero-shot Distribution Learning for Text Clustering via Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown impressive performance on downstream tasks, but if they cannot be fully described in prompts, they could fail to perform the task. |
| Approach: | They propose a method to contextualize a task toward a large language model (LLM) they use open-ended zero-shot inference from the entire dataset to aggregate the inference results and incorporate the aggregated meta-information for the actual task. |
| Outcome: | The proposed method improves text clustering tasks and improves on several datasets. |
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective (2022.emnlp-main)
Copied to clipboard
Ping Yang, Junjie Wang, Ruyi Gan, Xinyu Zhu, Lin Zhang, Ziwei Wu, Xinyu Gao, Jiaxing Zhang, Tetsuya Sakai
| Challenge: | Existing approaches to zero-shot learning are format-agnostic and can address new learning tasks without additional training. |
| Approach: | They propose a new paradigm for zero-shot learning that is format agnostic and compatible with any format and applicable to a list of language tasks. |
| Outcome: | The proposed model shows state-of-the-art performance on several benchmarks and produces satisfactory results on tasks such as text classification and commonsense reasoning. |