Long and Diverse Text Generation with Planning-based Hierarchical Variational Model (D19-1)
Copied to clipboard
| Challenge: | Existing methods for data-to-text generation are insufficient to produce long and diverse texts. |
| Approach: | They propose a planning-based hierarchical variational model that plans a sequence of groups and then realizes each sentence conditioned on the planning result and the previously generated context. |
| Outcome: | The proposed model outperforms state-of-the-art models in long and diverse text generation. |
Similar Papers
Data-to-text Generation with Variational Sequential Planning (2022.tacl-1)
Copied to clipboard
| Challenge: | Recent advances in data-to-text generation have greatly facilitated the task of generating textual output from non-linguistic input. |
| Approach: | They propose a neural model enhanced with a planning component responsible for organizing high-level information in a coherent and meaningful way. |
| Outcome: | The proposed model outperforms baseline models and is sample-efficient in the face of limited training data. |
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models (P19-1)
Copied to clipboard
| Challenge: | Variational autoencoders (VAEs) have received much attention as an end-to-end architecture for text generation with latent variables. |
| Approach: | They propose to leverage several multi-level structures to learn a variational autoencoder model for generating long, and coherent text. |
| Outcome: | The proposed model produces more coherent and less repetitive long text compared to baselines and mitigates posterior collapse issue. |
Data-to-text Generation with Macro Planning (2021.tacl-1)
Copied to clipboard
| Challenge: | Recent approaches to data-to-text generation adopt the encoder-decoder architecture . however, these models perform poorly at selecting appropriate content and ordering it coherently . |
| Approach: | They propose a neural model with a macro planning stage followed by a generation stage . they use data from databases of records, simulations of physical systems, accounting spreadsheets . |
| Outcome: | The proposed model outperforms baselines on two data-to-text benchmarks . it uses the encoderdecoder architecture and is compared with existing models . |
Plan-then-Generate: Controlled Data-to-Text Generation via Planning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on producing results that are close to the references, i.e. what to generate and in what order (the output structure) cannot be explicitly controlled by the users. |
| Approach: | They propose a Plan-then-Generate framework to improve the controllability of neural data-to-text models. |
| Outcome: | The proposed model can control both the intra-sentence and inter-sentent structure of the generated output. |
Sentence-Level Content Planning and Style Specification for Neural Text Generation (D19-1)
Copied to clipboard
| Challenge: | Recent advances in text generation systems often produce incoherent and unfaithful outputs . a novel automated text generation system takes into account content selection, text planning, and surface realization. |
| Approach: | They propose an end-to-end trained two-step text generation model that considers sentence-level content planners and language styles. |
| Outcome: | The proposed model outperforms competing models in three domains with diverse topics and varying language styles. |
Hierarchical Neural Story Generation (P18-1)
Copied to clipboard
| Challenge: | a hierarchical model that generates a premise and then conditions on it creates fluent text . a novel form of model fusion improves the relevance of the story to the prompt . |
| Approach: | They use a hierarchical model that first generates a premise, then transforms it into a text . they use fusion to improve relevance of the story to the prompt and add a gated mechanism to model context . |
| Outcome: | The proposed model improves on strong baselines on automated and human evaluations. |
DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing neural generation models fall short of coherence, thus requiring efficient content planning. |
| Approach: | They propose a generation framework that conducts dynamic planning of content while generating the output based on a novel design of mixed language models. |
| Outcome: | The proposed model outperforms competing models on argument generation and writing articles using New York Times’ Opinion section. |
Narrative Text Generation with a Latent Discrete Plan (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on story generation has focused on generating consistent stories via story outlines using keywords or key phrases. |
| Approach: | They propose a deep latent variable model that first samples a sequence of anchor words, one per sentence in the story, as part of its generative process. |
| Outcome: | The proposed model gets favorable scores when evaluated on perplexity, diversity, and control of story via discrete plan. |
Content Planning for Neural Story Generation with Aristotelian Rescoring (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to narrative composition are plagued by difficulty in mastering structure, will veer between topics, and lack long-range cohesion. |
| Approach: | They propose a plot-generation language model and a set of rescoring models that implement an aspect of good story-writing as detailed in Aristotle's Poetics. |
| Outcome: | The proposed system improves the quality of the narrative generated from the proposed model and improves its relevance to a given prompt and quality of stories written with our principled plot structure. |
Syntax-Infused Variational Autoencoder for Text Generation (P19-1)
Copied to clipboard
| Challenge: | Experimental results demonstrate the generative superiority of SIVAE on both reconstruction and targeted syntactic evaluations. |
| Approach: | They propose a syntax-infused variational autoencoder that integrates sentences with their syntactic trees to improve the grammar of generated sentences. |
| Outcome: | The proposed model improves the grammar of generated sentences by integrating sentences with syntactic trees. |