Challenge: Existing discourse parsers cannot predict coherent texts without using silver-standard features.
Approach: They propose a tree-recursive neural model which takes advantage of the text’s RST features produced by a state of the art RST parser and compares it to the current state of art.
Outcome: The proposed model achieves state-of-the-art accuracy on the Grammarly Corpus for Discourse Coherence (GCDC) and has 62% fewer parameters than existing models.

Similar Papers

Unleashing the Power of Neural Discourse Parsers - A Context and Structure Aware Approach Using Large Scale Pretraining (2020.coling-main)

Copied to clipboard

Challenge: Discourse parsing is an important upstream task within the area of Natural Language Processing (NLP) .
Approach: They propose a discourse parser that incorporates recent contextual language models to improve the performance of RST-based discourse parses.
Outcome: The proposed parser outperforms existing models on two key RST datasets and on large-scale "silver-standard" discourse treebank MEGA-DT.
Improving Neural RST Parsing Model with Silver Agreement Subtrees (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods for Rhetorical Structure Theory (RST) parsing use supervised learning, but the RST-DT is small due to the costly annotation of RST trees.
Approach: They propose to use silver data to improve RST parsing models by using annotated silver data.
Outcome: The proposed method achieves the best micro-F1 scores for Nuclearity and Relation at 75.0 and 63.2 . it also achieves a remarkable gain in relation score against the previous state-of-the-art parser.
Developing a Rhetorical Structure Theory Treebank for Czech (2024.lrec-main)

Copied to clipboard

Challenge: a paper on the Czech RST Discourse Treebank is the first version of a textual annotation system based on the Rhetorical Structure Theory . document is annotated using the RST, a global coherence model proposed by Mann and Thompson .
Approach: They introduce the first version of the Czech RST Discourse Treebank . paper presents an annotation process and provides corpus statistics and evaluation .
Outcome: The paper presents the first version of the Czech RST Discourse Treebank . the treebank includes two gold annotations representing divergent interpretations .
Evaluating Discourse in Structured Text Representations (P19-1)

Copied to clipboard

Challenge: Discourse structure is integral to understanding a text and is useful in many NLP tasks.
Approach: They propose a structured attention mechanism for text classification that derives a tree over a text, akin to an RST discourse tree.
Outcome: The proposed model improves performance on multiple discourse-relevant tasks and datasets and ablation studies show it does little to capture discourse structure.
How coherent are neural models of coherence? (2020.coling-main)

Copied to clipboard

Challenge: Existing approaches to model coherence are limited to small newswire corpora . evaluators need to be trained on lexical and document levels to perform evaluations .
Approach: They propose four generic evaluation tasks that capture coherence-specific properties . they aim at capturing correct use of discourse connectives and lexical cohesion .
Outcome: The proposed tasks capture coherence-specific properties, including correct use of discourse connectives, lexical cohesion, temporal consistency among events and participants in a story.
Discourse Relation-Enhanced Neural Coherence Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing work on coherence modeling has focused on integrating entity-based models.
Approach: They propose a model that integrates text- and relation-based features for coherence assessment using position-aware attention and a visible matrix.
Outcome: The proposed model improves baselines on two benchmarks and shows that relation features are important for coherence modeling.
Modeling discourse cohesion for discourse parsing via memory network (P18-2)

Copied to clipboard

Challenge: Existing approaches to discourse parsing focus on studying the semantic and syntactic aspects of EDU pairs, but they do not address long span dependencies.
Approach: They propose a new transition-based discourse parser that takes discourse cohesion into account by using memory networks.
Outcome: The proposed method outperforms traditional features and improves performance on the RST discourse treebank.
Centering-based Neural Coherence Modeling with Hierarchical Discourse Segments (2020.emnlp-main)

Copied to clipboard

Challenge: Prior studies of coherence focused on identifying semantic relations between adjacent sentences.
Approach: They propose a coherence model which takes discourse structural information into account without relying on human annotations.
Outcome: The proposed model performs state-of-the-art on automated essay scoring and assessing writing quality tasks.
RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods to integrate rhetorical structure theory into long document summarization models are unexplored.
Approach: They propose to integrate rhetorical structure theory into a long document summarization model by explicitly incorporating rhetorical uncertainty into the model.
Outcome: The proposed models outperform the vanilla LoRA and full-parameter fine-tuning models and outperformed previous state-of-the-art methods.
RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generators (2022.naacl-main)

Copied to clipboard

Challenge: Using a framework based on Rhetorical Structure Theory, we aim to improve the cohesion and coherence of long-form text generated by language models.
Approach: They propose a framework that utilises Rhetorical Structure Theory to control the discourse structure, semantics and topics of generated text.
Outcome: The proposed framework performs competitively against existing models while offering significantly more controls over generated text than alternative methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations