| Challenge: | Existing models for abstractive summarization suffer from repetition and semantic irrelevance. |
| Approach: | They propose a global encoding framework which controls the information flow from the encoder to the decoder based on the global information of the source context. |
| Outcome: | The proposed model outperforms baseline models on the LCSTS and English Gigaword and can generate summary of higher quality and reduce repetition. |
Similar Papers
On the Abstractiveness of Neural Document Summarization (D18-1)
Copied to clipboard
| Challenge: | Recent studies show that document summarization systems are abstractive . authors suggest that automated summarizing systems could be improved . |
| Approach: | They propose to use a pure copy system to verify abstractiveness of document summarization systems. |
| Outcome: | The proposed system produces abstractive summaries while being far more efficient. |
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents (N18-2)
Copied to clipboard
Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, Nazli Goharian
| Challenge: | Existing abstractive summarization models focus on summarizing sentences and short documents. |
| Approach: | They propose a hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary. |
| Outcome: | The proposed model significantly outperforms state-of-the-art models on two large-scale datasets of scientific papers. |
Controlling Length in Abstractive Summarization Using a Convolutional Neural Network (D18-1)
Copied to clipboard
| Challenge: | Convolutional neural networks (CNNs) can't generate summaries of desired lengths due to space or length constraints. |
| Approach: | They propose an approach to constrain the summary length by extending a convolutional sequence to sequence model. |
| Outcome: | The proposed model outperforms baseline models in terms of ROUGE score, length variations and semantic similarity. |
Enriching and Controlling Global Semantics for Text Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive summarization models have been proven effective in creating fluent and informative summaries, but they suffer from the short-range dependency problem, causing them to produce summary that miss the key points of document. |
| Approach: | They propose a neural topic model empowered with normalizing flow to capture global semantics of the document and integrate them into the summarization model. |
| Outcome: | The proposed model outperforms state-of-the-art summarization models on five common text summarizing datasets, namely CNN/DailyMail, XSum, Reddit TIFU, arXiv, and PubMed. |
Deep Communicating Agents for Abstractive Summarization (N18-1)
Copied to clipboard
| Challenge: | Empirical results show that multiple communicating agents produce a better summary than extractive summarization. |
| Approach: | They propose an encoder-decoder architecture that uses deep communicating agents to represent a long document for abstractive summarization. |
| Outcome: | Empirical results show that multiple communicating agents produce a better summary than baselines. |
Pre-training for Abstractive Document Summarization by Reinstating Source Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive document summarization models are often trained on limited supervised data . authors present three objectives for pretraining abstractive summarizing models . |
| Approach: | They propose to pre-train a SEQ2SEQ based abstractive summarization model on unlabeled text. |
| Outcome: | The proposed method improves on two benchmark summarization datasets with 19GB of text . the goal is sentence reordering, next sentence generation and masked document generation . |
Abstractive Summarizers are Excellent Extractive Summarizers (2023.acl-short)
Copied to clipboard
| Challenge: | Abstractive summarization systems have traditionally been fragmented, limiting the benefits of compatible models. |
| Approach: | They propose three new inference algorithms using sequence-to-sequence architectures to model extractive summarization with an abstractive summmarization system. |
| Outcome: | The proposed algorithms outperform existing models on CNN and Dailymail and show that they are more efficient than existing models. |
Don’t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to summarize documents are not extractive and require an abstractive approach. |
| Approach: | They propose a novel abstractive model which is conditioned on the article’s topics and based entirely on convolutional neural networks. |
| Outcome: | The proposed model outperforms an oracle extractive system and state-of-the-art abstractive approaches when evaluated automatically and by humans. |
StructSum: Summarization via Structured Representations (2021.eacl-main)
Copied to clipboard
Vidhisha Balachandran, Artidoro Pagnoni, Jay Yoon Lee, Dheeraj Rajagopal, Jaime Carbonell, Yulia Tsvetkov
| Challenge: | Abstractive summarization models overfit to training corpora, lack of transparency and layout bias . authors propose incorporating latent and explicit dependencies across sentences in source document . |
| Approach: | They propose a framework based on document-level structure induction to address layout bias and lack of transparency in abstractive summarization models. |
| Outcome: | The proposed framework improves coverage of content in the source documents and generates more abstractive summaries by generating more novel n-grams. |
Abstractive Multi-Document Summarization via Joint Learning with Single-Document Summarization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for document summarization are extractive and abstractive. |
| Approach: | They propose to jointly learn an abstractive single-document decoder and a decoding controller to aggregate the decoded outputs for multiple input documents. |
| Outcome: | The proposed model outperforms several baselines on two multi-document summarization datasets and proves that it is useful for both tasks. |