Challenge: Abstractive summarization methods use factual and grammatical errors to generate summaries.
Approach: They propose a neural sequence-to-sequence model for extractive summarization called SWAP-NET . it identifies salient sentences and key words in an input document and combines them to form an extractive summary.
Outcome: The proposed model outperforms state-of-the-art extractive summarization methods on large scale corpora.

Similar Papers

Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)

Copied to clipboard

Challenge: Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved.
Approach: They propose to use different types of model architectures to improve extractive summarization systems.
Outcome: The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis.
Neural Document Summarization by Jointly Learning to Score and Select Sentences (P18-1)

Copied to clipboard

Challenge: Sentence scoring and sentence selection are two main steps in extractive document summarization systems.
Approach: They propose an end-to-end neural network framework for extractive document summarization by jointly learning to score and select sentences.
Outcome: The proposed framework outperforms the state-of-the-art summarization models on the CNN/Daily Mail dataset.
A Set Prediction Network For Extractive Summarization (2023.findings-acl)

Copied to clipboard

Challenge: Recent approaches to extracting salient sentences from source document are naive and lack dependencies between sentences.
Approach: They propose a set prediction network to detect redundancy relationship between sentences . they use a non-autoregressive decoder to predict sentences in parallel .
Outcome: The proposed method outperforms previous state-of-the-art models on extracted summary datasets.
Heterogeneous Graph Neural Networks for Extractive Document Summarization (2020.acl-main)

Copied to clipboard

Challenge: Existing models capture cross-sentence relations with recurrent neural networks, but they are hard to capture sentence-level long-distance dependency.
Approach: They propose a graph-based neural network for extractive summarization which contains semantic nodes apart from sentences.
Outcome: The proposed graph-based neural network is the first to incorporate different types of nodes into it and perform a qualitative analysis.
Multi Graph Neural Network for Extractive Long Document Summarization (2022.coling-1)

Copied to clipboard

Challenge: Heterogeneous Graph Neural Networks (GNN) have been proposed as an emergent approach for extracting document summarization (EDS) but there are still limitations in applying it for long documents due to the lack of inter-sentence connections.
Approach: They propose to build a graph on sentence-level nodes and combine it with HeterGNN to capture the semantic information in terms of both inter and intra-sentence connections.
Outcome: Experiments on two datasets show that the proposed method achieves state-of-the-art in this research field.
GraphLSS: Integrating Lexical, Structural, and Semantic Features for Long Document Extractive Summarization (2025.naacl-short)

Copied to clipboard

Challenge: Graph-based methods for extracting documents have been popular, but they often require external tools or additional machine learning models to define graph components.
Approach: They propose a heterogeneous graph construction for extractive summarization that defines two levels of information and four types of edges without any need for auxiliary learning models.
Outcome: The proposed graph construction outperforms previous graph-based models on two datasets and is available on GitHub.
Sliding Selector Network with Dynamic Memory for Extractive Summarization of Long Documents (2021.naacl-main)

Copied to clipboard

Challenge: Existing summarization models suffer from the length limitation of text encoder, which results in huge loss of summary-relevant contents.
Approach: They propose a sliding selector network with dynamic memory for extractive summarization of long-form documents that employs a window to extract summary sentences segment by segment.
Outcome: The proposed model outperforms state-of-the-art models on two large-scale datasets showing that it is highly efficient and fluent.
Extractive Summarization as Text Matching (2020.acl-main)

Copied to clipboard

Challenge: Currently, most of the neural extractive summarization systems score and extract sentences individually and model the relationship between sentences.
Approach: They propose to instantiate a neural extractive summarization task as a semantic text matching problem and use it to match a source document and candidate summaries in a semantic space.
Outcome: The proposed framework is faster and more efficient than existing frameworks.
An Editorial Network for Enhanced Document Summarization (D19-54)

Copied to clipboard

Challenge: Existing extractive and abstractive summarization methods are less fluent, coherent and readable, whereas extractive methods are sensitive to vocabulary size, making them more difficult to train and generalize.
Approach: They propose an approach which uses a combination of extractive and abstractive methods to combine a given sequence of sentences into a short version.
Outcome: The proposed method is compared with state-of-the-art methods using extractive-only or abstractive- only baselines.
Neural Extractive Text Summarization with Syntactic Compression (D19-1)

Copied to clipboard

Challenge: Recent approaches to summarization are either selection-based extraction or generation-based abstraction.
Approach: They propose a neural model for single-document summarization based on joint extraction and syntactic compression.
Outcome: The proposed model outperforms an off-the-shelf compression module and its output generally remains grammatical.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations