| Challenge: | Unsupervised approaches to generating text from structured data are costly to obtain and limited to a limited domain. |
| Approach: | They propose an unsupervised approach that learns its parameters without the slot pairs on target sequences only. |
| Outcome: | The proposed approach can generate sentences out of corrupted data without supervision . it can be used in question answering and dialog systems, the authors show . |
Similar Papers
How to Make Neural Natural Language Generation as Reliable as Templates in Task-Oriented Dialogue (2020.emnlp-main)
Copied to clipboard
| Challenge: | Neural Natural Language Generation (NLG) systems are well known for their unreliability. |
| Approach: | They propose a data augmentation approach which restricts the output of a neural network and guarantees reliability. |
| Outcome: | The proposed approach scored 100% in semantic accuracy on the E2E NLG Challenge dataset, the same as a template system. |
Natural Language Generation by Hierarchical Decoding with Linguistic Patterns (N18-2)
Copied to clipboard
| Challenge: | a common and mostly adopted method is the rule-based (or template-based) method for natural language generation. |
| Approach: | They propose a hierarchical decoding NLG model based on linguistic patterns in different levels. |
| Outcome: | The proposed method outperforms the traditional one with a smaller model size. |
Faithful Low-Resource Data-to-Text Generation through Cycle Training (2023.acl-long)
Copied to clipboard
| Challenge: | Methods to generate text from structured data have advanced significantly in recent years, but can fail to produce output faithful to the input data, especially on out-of-domain data. |
| Approach: | They evaluate the effectiveness of cycle training by using two models which are inverses of each other to generate text from structured data and one which generates the structured data from natural language text. |
| Outcome: | The proposed approach achieves nearly the same performance as fully supervised approaches on the WebNLG, E2E, WTQ, and WSQL datasets. |
Annotating FrameNet via Structure-Conditioned Language Generation (2024.acl-short)
Copied to clipboard
| Challenge: | despite the remarkable generative capabilities of language models, their effectiveness on explicit manipulation and generation of linguistic structures remains understudied. |
| Approach: | They propose a framework to generate frame-semantically annotated sentences following FrameNet . they use explicit semantic information to generate frames with high human acceptance . |
| Outcome: | The proposed framework produces frame-semantic annotations with high human acceptance . generating high-quality, semantically rich data is effective in low-resource settings, but not under higher resource settings. |
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that large pretrained language models can generate training data with no task-specific or cross-task data. |
| Approach: | They propose a retrieval-enhanced framework to create training data from a general-domain unlabeled corpus. |
| Outcome: | The proposed framework achieves 4.3% gain over baselines and saves 70% of time compared with baselines using large language models. |
Logic2Text: High-Fidelity Natural Language Generation from Logical Forms (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies on Natural Language Generation (NLG) from structured data focus on surface descriptions of simple record sequences, for example, attribute-value pairs of fixed or very limited schema. |
| Approach: | They propose to use a large-scale dataset to generate NLG from logical forms to obtain controllable and faithful generations from structured data. |
| Outcome: | The proposed model can describe interesting facts from logical inferences across records, but it is difficult to produce such fidelity. |
Programmable Annotation with Diversed Heuristics and Data Denoising (2022.coling-1)
Copied to clipboard
| Challenge: | Neural natural language generation and understanding models require massive amounts of annotated data to be competitive. |
| Approach: | They propose a data programming framework that can jointly construct labeled data for language generation and understanding tasks by allowing annotators to modify an automatically-inferred alignment rule set between sequence labels and text. |
| Outcome: | The proposed framework generates high-quality data within a 1.48 BLEU and 6.42 slot F1 of 100% human-labeled data with just 100 labeled data samples outperforming benchmark annotation frameworks and other semi-supervised approaches. |
The Amazing World of Neural Language Generation (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | Recent years have seen a paradigm shift in neural text generation due to advances in deep contextual language modeling and transfer learning. |
| Approach: | They will discuss how and why NLG models succeed/fail at generating coherent text. |
| Outcome: | This paper will discuss how and why these models succeed/fail at generating coherent text, and provide insights on several applications. |
Automatic and Human-AI Interactive Text Generation (with a focus on Text Simplification and Revision) (2024.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we focus on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and then generates a revision that is improved according to some specific criteria. |
| Approach: | This tutorial focuses on text-to-text generation, a class of natural language generation tasks that takes a piece of text as input and generates a revision that is improved according to some specific criteria. |
| Outcome: | This tutorial focuses on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and generates a revision that is improved according to some specificcriteria. |
Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data (2020.coling-industry)
Copied to clipboard
Ankit Arun, Soumya Batra, Vikas Bhardwaj, Ashwini Challa, Pinar Donmez, Peyman Heidari, Hakan Inan, Shashank Jain, Anuj Kumar, Shawn Mei, Karthik Mohan, Michael White
| Challenge: | Natural language generation (NLG) is a critical component in conversational systems . Traditionally, NLG components have been deployed using template-based solutions . however, deployment of such model-based systems has been challenging due to high latency and data needs. |
| Approach: | They propose a family of techniques to deploy data-efficient neural solutions for NLG in conversational systems to production. |
| Outcome: | The proposed techniques achieve production quality with light-weight neural network models using fraction of the data needed otherwise. |