Challenge: Existing methods for document summarization use extractive and abstractive representations, but they don't take into account hierarchical structure of document clusters.
Approach: They propose a multi-granularity interaction network for extractive and abstractive multi-document summarization which jointly learn semantic representations for words, sentences, and documents.
Outcome: The proposed model outperforms baseline methods and achieves the best results on the Multi-News dataset.

Similar Papers

Topic-Guided Abstractive Multi-Document Summarization (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on multi-document summarization (MDS) focus on extractive and abstractive approaches to create a fluent and concise summary for a collection of thematically related documents.
Approach: They propose a novel abstractive MDS model that represents multiple documents as a heterogeneous graph and then applies a graph-to-sequence framework to generate summaries.
Outcome: The proposed model outperforms state-of-the-art models on Rouge scores and human evaluation, while learning high-quality topics.
Abstractive Multi-Document Summarization via Joint Learning with Single-Document Summarization (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for document summarization are extractive and abstractive.
Approach: They propose to jointly learn an abstractive single-document decoder and a decoding controller to aggregate the decoded outputs for multiple input documents.
Outcome: The proposed model outperforms several baselines on two multi-document summarization datasets and proves that it is useful for both tasks.
Leveraging Graph to Improve Abstractive Multi-Document Summarization (2020.acl-main)

Copied to clipboard

Challenge: Empirical results show that our model brings substantial improvements over several strong baselines.
Approach: They propose a neural abstractive multi-document summarization model which captures cross-document relations and can guide the summary generation process.
Outcome: The proposed model improves on the WikiSum and MultiNews datasets and can be easily combined with pre-trained language models.
Multiplex Graph Neural Network for Extractive Text Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for extractive text summarization do not consider multiple types of inter-sentential relationships, nor model intra-sententential relationships.
Approach: They propose a novel method to combine different types of relationships among sentences and words to model sentence embedding.
Outcome: The proposed model is compared with existing methods on CNN/DailyMail benchmark dataset to demonstrate its effectiveness.
Heterogeneous Graph Neural Networks for Extractive Document Summarization (2020.acl-main)

Copied to clipboard

Challenge: Existing models capture cross-sentence relations with recurrent neural networks, but they are hard to capture sentence-level long-distance dependency.
Approach: They propose a graph-based neural network for extractive summarization which contains semantic nodes apart from sentences.
Outcome: The proposed graph-based neural network is the first to incorporate different types of nodes into it and perform a qualitative analysis.
A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss (P18-1)

Copied to clipboard

Challenge: extractive models can obtain sentence-level attention with high ROUGE scores but less readable. abstractive models generate novel words and phrases not copied from the source text.
Approach: They propose to combine extractive and abstractive models to achieve a unified model that generates readable paragraphs with word-level attention.
Outcome: The proposed model achieves state-of-the-art ROUGE scores while being the most informative and readable summarization on the CNN/Daily Mail dataset in a solid human evaluation.
GraphLSS: Integrating Lexical, Structural, and Semantic Features for Long Document Extractive Summarization (2025.naacl-short)

Copied to clipboard

Challenge: Graph-based methods for extracting documents have been popular, but they often require external tools or additional machine learning models to define graph components.
Approach: They propose a heterogeneous graph construction for extractive summarization that defines two levels of information and four types of edges without any need for auxiliary learning models.
Outcome: The proposed graph construction outperforms previous graph-based models on two datasets and is available on GitHub.
Abstractive Summarizers are Excellent Extractive Summarizers (2023.acl-short)

Copied to clipboard

Challenge: Abstractive summarization systems have traditionally been fragmented, limiting the benefits of compatible models.
Approach: They propose three new inference algorithms using sequence-to-sequence architectures to model extractive summarization with an abstractive summmarization system.
Outcome: The proposed algorithms outperform existing models on CNN and Dailymail and show that they are more efficient than existing models.
On the Abstractiveness of Neural Document Summarization (D18-1)

Copied to clipboard

Challenge: Recent studies show that document summarization systems are abstractive . authors suggest that automated summarizing systems could be improved .
Approach: They propose to use a pure copy system to verify abstractiveness of document summarization systems.
Outcome: The proposed system produces abstractive summaries while being far more efficient.
Integrating Semantic Scenario and Word Relations for Abstractive Sentence Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing graph-based methods only consider word relations or structure information, which neglect the correlation between them.
Approach: They propose a Dual Graph network for Abstractive Sentence Summarization that captures word relations and structure information from sentences.
Outcome: The proposed model outperforms state-of-the-art methods on two popular benchmark datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations