Challenge: a novel approach to paragraph planning involves a high-level control of different levels of relations between sentences . a proposed model with both forms of relations outperforms baselines in partially conditioned paragraph generation task .
Approach: They propose two models that integrate human-created and latent relations into document-level language models . they focus on paragraph-level plan between sentences to produce coherent text .
Outcome: The proposed models outperform baselines in partially conditioned paragraph generation task.

Similar Papers

Improving Implicit Discourse Relation Classification by Modeling Inter-dependencies of Discourse Units in a Paragraph (N18-1)

Copied to clipboard

Challenge: Existing methods for predicting implicit discourse relations ignore wider paragraph contexts beyond the two discourse units examined for a discourse relation prediction.
Approach: They propose a paragraph-level neural network that models inter-dependencies between discourse units and discourse relation continuity and patterns and predicts a sequence of discourse relations in a sentence.
Outcome: The proposed model outperforms state-of-the-art systems on the benchmark corpus of PDTB.
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence (2021.acl-long)

Copied to clipboard

Challenge: Existing generation models struggle to maintain a coherent event sequence throughout the generated text.
Approach: They propose a long text generation model which can represent prefix sentences at sentence level and discourse level in the decoding process.
Outcome: The proposed model can generate more coherent texts than state-of-the-art models.
Latent Structure Models for Natural Language Processing (P19-4)

Copied to clipboard

Challenge: Latent structure models are a powerful tool for compositional data modeling and pipelines.
Approach: This tutorial will cover recent advances in discrete latent structure models . it will discuss their motivation, potential, and limitations .
Outcome: This tutorial will cover recent advances in discrete latent structure models . it will discuss their motivation, potential, and limitations .
Text Generation from Discourse Representation Structures (2021.naacl-main)

Copied to clipboard

Challenge: Existing models to generate text from formal meaning representations based on Discourse Representation Structures (DRSs) .
Approach: They propose neural models to generate text from formal meaning representations based on Discourse Representation Structures (DRSs).
Outcome: The proposed model achieves competitive performance on the GMB benchmark against several strong baselines.
Attribute Alignment: Controlling Text Generation from Pre-trained Language Models (2021.findings-emnlp)

Copied to clipboard

Challenge: Large language models can generate text with sentiment polarity or specific topics without changing the original model parameters.
Approach: They propose a method for controlling text generation by aligning disentangled attribute representations.
Outcome: The proposed method shows large performance gains while maintaining diversity and fluency.
Sentence-Level Content Planning and Style Specification for Neural Text Generation (D19-1)

Copied to clipboard

Challenge: Recent advances in text generation systems often produce incoherent and unfaithful outputs . a novel automated text generation system takes into account content selection, text planning, and surface realization.
Approach: They propose an end-to-end trained two-step text generation model that considers sentence-level content planners and language styles.
Outcome: The proposed model outperforms competing models in three domains with diverse topics and varying language styles.
Text-to-Text Automatic Story Generation: A Survey (2026.eacl-srw)

Copied to clipboard

Challenge: Automated story generation aims to produce coherent, engaging, and contextually consistent narratives with minimal or no human involvement . despite advances in large language models, maintaining narrative coherence, character consistency, storyline diversity, and plot controllability in generating stories is still challenging.
Approach: They propose to develop new evaluation metrics and better data sets to support automatic story generation.
Outcome: The proposed evaluation metrics and better datasets will improve narrative coherence and consistency and explore practical applications of story generation.
Reasoning with Latent Structure Refinement for Document-Level Relation Extraction (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for document-level relation extraction capture non-local interactions but are not able to capture rich non-linguistic interactions.
Approach: They propose a document-level relation extraction model that empowers relational reasoning across sentences by automatically inducing the latent document- level graph.
Outcome: The proposed model achieves an F1 score of 59.05 on a large-scale document-level dataset (DocRED), significantly improving over the previous results.
Towards Inter-character Relationship-driven Story Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Recent story generation methods can generate stories based on open-ended prompts and planners but can neither encode character relationships nor give explicit control over the characters and their relationships.
Approach: They propose a model that uses relationships as latent variables for story generation and propose 'relationship-driven' story generation.
Outcome: The proposed model generates stories sentence by sentence with relationships that are more faithful to desired relationships while maintaining the content quality.
Towards Content Transfer through Grounded Text Generation (N19-1)

Copied to clipboard

Challenge: Recent work in neural natural language generation has attracted significant interest in controlling the form of text, such as style, persona, and wordiness.
Approach: They propose a task where the task is to generate a next sentence in a document that fits its context and is grounded in . external textual source such as a news story.
Outcome: The proposed task is based on 640k Wikipedia referenced sentences paired with the source articles to show significant improvements against baselines.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations