| Challenge: | Recent work in neural natural language generation has attracted significant interest in controlling the form of text, such as style, persona, and wordiness. |
| Approach: | They propose a task where the task is to generate a next sentence in a document that fits its context and is grounded in . external textual source such as a news story. |
| Outcome: | The proposed task is based on 640k Wikipedia referenced sentences paired with the source articles to show significant improvements against baselines. |
Similar Papers
Sentence-Level Content Planning and Style Specification for Neural Text Generation (D19-1)
Copied to clipboard
| Challenge: | Recent advances in text generation systems often produce incoherent and unfaithful outputs . a novel automated text generation system takes into account content selection, text planning, and surface realization. |
| Approach: | They propose an end-to-end trained two-step text generation model that considers sentence-level content planners and language styles. |
| Outcome: | The proposed model outperforms competing models in three domains with diverse topics and varying language styles. |
Hierarchical Neural Story Generation (P18-1)
Copied to clipboard
| Challenge: | a hierarchical model that generates a premise and then conditions on it creates fluent text . a novel form of model fusion improves the relevance of the story to the prompt . |
| Approach: | They use a hierarchical model that first generates a premise, then transforms it into a text . they use fusion to improve relevance of the story to the prompt and add a gated mechanism to model context . |
| Outcome: | The proposed model improves on strong baselines on automated and human evaluations. |
Neural Text Generation in Stories Using Entity Representations as Context (N18-1)
Copied to clipboard
| Challenge: | Existing models of text generation that explicitly represent entities are based on the use of words and entities. |
| Approach: | They propose a neural model that explicitly represents entities mentioned in the text . they use vectors that are updated as the text proceeds to improve automatic evaluations . |
| Outcome: | The proposed model improves mention generation, sentence selection, and sentence generation. |
Enhancing Neural Data-To-Text Generation Models with External Background Knowledge (D19-1)
Copied to clipboard
| Challenge: | Recent neural models for data-to-text generation rely on parallel pairs of data and text to learn writing knowledge. |
| Approach: | They propose to enhance neural models with external knowledge to improve fidelity of generated text. |
| Outcome: | The proposed model improves on Wikipedia infobox-to-text datasets on 21 datasets. |
Paraphrase Generation: A Survey of the State of the Art (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using neural models, paraphrase generation research has shifted to neural methods . a recent study focused on paraphrases, which are used in language understanding tasks . |
| Approach: | They propose to use neural methods to generate fluent, diverse paraphrases from a sentence . they propose to combine large pretrained language models with other mechanisms to generate more advanced paraphrase generation models. |
| Outcome: | This paper examines various approaches to paraphrase generation with a main focus on neural methods. |
Keyphrase Generation Beyond the Boundaries of Title and Abstract (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to keyphrase generation use only the title and abstract of the articles. |
| Approach: | They propose to integrate full text and semantically similar articles to generate keyphrases from a dataset that includes the full text of the articles along with the title and abstract. |
| Outcome: | The proposed model can generate keyphrases that are present or absent from the text. |
The Amazing World of Neural Language Generation (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | Recent years have seen a paradigm shift in neural text generation due to advances in deep contextual language modeling and transfer learning. |
| Approach: | They will discuss how and why NLG models succeed/fail at generating coherent text. |
| Outcome: | This paper will discuss how and why these models succeed/fail at generating coherent text, and provide insights on several applications. |
Content Planning for Neural Story Generation with Aristotelian Rescoring (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to narrative composition are plagued by difficulty in mastering structure, will veer between topics, and lack long-range cohesion. |
| Approach: | They propose a plot-generation language model and a set of rescoring models that implement an aspect of good story-writing as detailed in Aristotle's Poetics. |
| Outcome: | The proposed system improves the quality of the narrative generated from the proposed model and improves its relevance to a given prompt and quality of stories written with our principled plot structure. |
Cue Me In: Content-Inducing Approaches to Interactive Story Generation (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing methods for automatic story generation focus on one-shot generation, but we focus on interactive story generation. |
| Approach: | They propose two ways to incorporate user-provided cue phrases into automatic story generation. |
| Outcome: | The proposed approach produces more topically coherent and personalized stories than baseline methods. |
Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic Fidelity (2020.coling-main)
Copied to clipboard
| Challenge: | End-to-end neural data-totext generation has faced challenges generalizing to new domains and generating semantically consistent text. |
| Approach: | They propose a neural data-to-text generation system that makes minimal assumptions about the data representation and target domain. |
| Outcome: | The proposed system achieves state of the art results on four major D2T datasets with better semantic fidelity than the state-of-the-art methods. |