Sentence Centrality Revisited for Unsupervised Summarization (P19-1)

Copied to clipboard

Challenge: Experimental results on three news summarization datasets representative of different languages and writing styles show that our approach outperforms strong baselines by a wide margin.
Approach: They propose an unsupervised approach that uses a popular ranking algorithm to compute node centrality.
Outcome: The proposed approach outperforms baselines on three news summarization datasets representative of different languages and writing styles.

Similar Papers

Improving Unsupervised Extractive Summarization with Facet-Aware Modeling (2021.findings-acl)

Copied to clipboard

Challenge: Existing extractive summarization methods tend to select sentences within the same facet, which leads to facet bias.
Approach: They propose a facet-aware centrality-based ranking model that gives a weight to the sentence centrality score.
Outcome: The proposed method outperforms baseline models on a wide range of summarization tasks and performs comparably to other models.
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for document summarization use graphs and unlabeled documents . Existing models require labeled data, and it is expensive to create summarized documents.
Approach: They propose to rank sentences using transformer attentions and pre-training objectives by unlabeled documents.
Outcome: The proposed model achieves state-of-the-art on unsupervised summarization and is less dependent on sentence positions.
Learning From the Source Document: Unsupervised Abstractive Summarization (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for abstractive summarization are under supervised training, but obtaining high-quality and large-scale datasets for supervised learning is laboriously difficult.
Approach: They propose an unsupervised method that leverages contrastive learning to generate summaries by rewriting and paraphrasing the source documents to generate good summary.
Outcome: The proposed method outperforms baseline methods on extensive experiments on source documents and fake documents.
Bipartite Graph Pre-training for Unsupervised Extractive Summarization with Graph Convolutional Auto-Encoders (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to rank sentences using pre-trained embeddings create a gap due to different optimization objectives.
Approach: They propose a pre-trained embedding process that optimizes informative sentences . they use sentence-word bipartite graphs to model intra-sentential distinctive features .
Outcome: The proposed model outperforms heavy BERT- or RoBERTa-based sentence ranking methods by providing summary-worthy representations.
Unsupervised Neural Single-Document Summarization of Reviews via Learning Latent Discourse Structure and its Ranking (P19-1)

Copied to clipboard

Challenge: Currently, unsupervised summarization is widely used for product reviews on E-commerce websites.
Approach: They propose an unsupervised model that learns the latent discourse tree without an external parser and generates a concise summary.
Outcome: The proposed model outperforms other unsupervised approaches for relatively long reviews and is competitive with or better than supervised models.
Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)

Copied to clipboard

Challenge: Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved.
Approach: They propose to use different types of model architectures to improve extractive summarization systems.
Outcome: The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis.
Discourse-Aware Unsupervised Summarization for Long Scientific Documents (2021.eacl-main)

Copied to clipboard

Challenge: Existing extractive models for short news summarization are weak, despite recent advances in abstractive summarizing.
Approach: They propose an unsupervised graph-based ranking model that uses a hierarchical graph representation to determine sentence importance.
Outcome: The proposed model outperforms strong unsupervised baselines by wide margins in automatic metrics and human evaluation.
Discrete Optimization for Unsupervised Sentence Summarization with Word-Level Extraction (2020.acl-main)

Copied to clipboard

Challenge: Sentence summarization systems that use latent space to reconstruct the source sentence are unwillingly exploited.
Approach: They propose a method that uses language modeling and semantic similarity metrics to find a high-scoring summary.
Outcome: The proposed method achieves state-of-the-art for unsupervised sentence summarization according to ROUGE scores.
Simple Unsupervised Summarization by Contextual Matching (P19-1)

Copied to clipboard

Challenge: Existing methods for sentence summarization require a large amount of parallel data for supervision to work.
Approach: They propose an unsupervised method for sentence summarization using only language modeling.
Outcome: The proposed method maintains continuous contextual matching while maintaining output fluency without any paired examples.
Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximization (P18-1)

Copied to clipboard

Challenge: a novel graph-based framework for abstractive meeting speech summarization is developed . instead of grammatical, well-segmented sentences, the input is made of often ill-formed and ungrammatically ungrammatized text fragments called utterances.
Approach: They propose a graph-based framework for abstractive meeting speech summarization that is fully unsupervised and does not rely on annotations.
Outcome: The proposed framework improves on the state-of-the-art on the AMI and ICSI corpus.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations