| Challenge: | Recent approaches to extracting salient sentences from source document are naive and lack dependencies between sentences. |
| Approach: | They propose a set prediction network to detect redundancy relationship between sentences . they use a non-autoregressive decoder to predict sentences in parallel . |
| Outcome: | The proposed method outperforms previous state-of-the-art models on extracted summary datasets. |
Similar Papers
Neural Document Summarization by Jointly Learning to Score and Select Sentences (P18-1)
Copied to clipboard
| Challenge: | Sentence scoring and sentence selection are two main steps in extractive document summarization systems. |
| Approach: | They propose an end-to-end neural network framework for extractive document summarization by jointly learning to score and select sentences. |
| Outcome: | The proposed framework outperforms the state-of-the-art summarization models on the CNN/Daily Mail dataset. |
Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)
Copied to clipboard
| Challenge: | Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved. |
| Approach: | They propose to use different types of model architectures to improve extractive summarization systems. |
| Outcome: | The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis. |
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for document summarization use graphs and unlabeled documents . Existing models require labeled data, and it is expensive to create summarized documents. |
| Approach: | They propose to rank sentences using transformer attentions and pre-training objectives by unlabeled documents. |
| Outcome: | The proposed model achieves state-of-the-art on unsupervised summarization and is less dependent on sentence positions. |
Extractive Summarization as Text Matching (2020.acl-main)
Copied to clipboard
| Challenge: | Currently, most of the neural extractive summarization systems score and extract sentences individually and model the relationship between sentences. |
| Approach: | They propose to instantiate a neural extractive summarization task as a semantic text matching problem and use it to match a source document and candidate summaries in a semantic space. |
| Outcome: | The proposed framework is faster and more efficient than existing frameworks. |
Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networks (2020.coling-main)
Copied to clipboard
| Challenge: | Existing extractive summarization models hardly capture inter-sentence relationships, especially in long documents. |
| Approach: | They propose to use a graph neural network to capture inter-sentence relationships efficiently via graph-structured document representation. |
| Outcome: | The proposed model outperforms existing models on CNN/DM and NYT datasets and significantly outperfies them on longer documents. |
AREDSUM: Adaptive Redundancy-Aware Iterative Sentence Ranking for Extractive Document Summarization (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on redundancy are focused on salience alone. |
| Approach: | They propose to combine salience and novelty to score redundancy in extractive summarization systems . they also propose to balance saliance and redundancies by scoring redundants first . |
| Outcome: | Empirical results show that AREDSUM-CTX scores salience first, then learns to balance saliency and redundancy. |
Neural Extractive Text Summarization with Syntactic Compression (D19-1)
Copied to clipboard
| Challenge: | Recent approaches to summarization are either selection-based extraction or generation-based abstraction. |
| Approach: | They propose a neural model for single-document summarization based on joint extraction and syntactic compression. |
| Outcome: | The proposed model outperforms an off-the-shelf compression module and its output generally remains grammatical. |
BottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principle (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to extractive and abstractive summarization rely on large-scale parallel corpora of input text and output summaries for direct supervision. |
| Approach: | They propose an unsupervised approach to sentence summarization using the Information Bottleneck principle. |
| Outcome: | The proposed method outperforms unsupervised models on automatic metrics and human evaluation along multiple attributes. |
Heterogeneous Graph Neural Networks for Extractive Document Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models capture cross-sentence relations with recurrent neural networks, but they are hard to capture sentence-level long-distance dependency. |
| Approach: | They propose a graph-based neural network for extractive summarization which contains semantic nodes apart from sentences. |
| Outcome: | The proposed graph-based neural network is the first to incorporate different types of nodes into it and perform a qualitative analysis. |
Exploiting Discourse-Level Segmentation for Extractive Summarization (D19-54)
Copied to clipboard
| Challenge: | Existing approaches to extract summarize text are based on sentences as the elementary unit, but semantic segments containing supplementary information or descriptive details are often nonessential in the generated summaries. |
| Approach: | They propose to exploit discourse-level segmentation as a finer-grained means to more precisely pinpoint the core content in a document. |
| Outcome: | The proposed method improves extractive summarization performance on CNN/Daily Mail dataset. |