Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting (P18-1)
Copied to clipboard
| Challenge: | Empirically, we achieve the new state-of-the-art on all metrics (including human evaluation) on the CNN/Daily Mail dataset, as well as significantly higher abstractiveness scores. |
| Approach: | They propose a sentence-level policy gradient method that bridges computation between two neural networks in a hierarchical way while maintaining language fluency. |
| Outcome: | The proposed model achieves state-of-the-art on all metrics and higher abstractiveness scores on the CNN/Daily Mail dataset and faster training convergence than previous models. |
Similar Papers
Summary Level Training of Sentence Rewriting for Abstractive Summarization (D19-54)
Copied to clipboard
| Challenge: | Existing models rely on sentence-level rewards or suboptimal labels to achieve summary-level ROUGE scores. |
| Approach: | They propose a model that extracts salient sentences from a document and paraphrases them to generate a summary. |
| Outcome: | The proposed model improves on CNN/Daily Mail and New York Times datasets. |
Abstractive Document Summarization without Parallel Data (2020.lrec-1)
Copied to clipboard
| Challenge: | Abstractive summarization typically relies on large collections of paired articles and summaries. |
| Approach: | They propose a system that relies only on example summaries and non-matching articles . they use an unsupervised sentence extractor that selects salient sentences . |
| Outcome: | The proposed system performs well on CNN/DailyMail benchmark and automatic generating a press release from a scientific journal article. |
Jointly Extracting and Compressing Documents with Summary State Representations (N19-1)
Copied to clipboard
| Challenge: | Text summarization is an important NLP problem with a wide range of applications in data-driven industries. |
| Approach: | They propose a neural model that extracts sentences from a document and compresses them. |
| Outcome: | The proposed model generates concise and informa-tive summaries on CNN/DailyMail and Newsroom datasets and human evaluations show it outperforms existing methods. |
StructSum: Summarization via Structured Representations (2021.eacl-main)
Copied to clipboard
Vidhisha Balachandran, Artidoro Pagnoni, Jay Yoon Lee, Dheeraj Rajagopal, Jaime Carbonell, Yulia Tsvetkov
| Challenge: | Abstractive summarization models overfit to training corpora, lack of transparency and layout bias . authors propose incorporating latent and explicit dependencies across sentences in source document . |
| Approach: | They propose a framework based on document-level structure induction to address layout bias and lack of transparency in abstractive summarization models. |
| Outcome: | The proposed framework improves coverage of content in the source documents and generates more abstractive summaries by generating more novel n-grams. |
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents (N18-2)
Copied to clipboard
Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, Nazli Goharian
| Challenge: | Existing abstractive summarization models focus on summarizing sentences and short documents. |
| Approach: | They propose a hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary. |
| Outcome: | The proposed model significantly outperforms state-of-the-art models on two large-scale datasets of scientific papers. |
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | We present a method to produce abstractive summaries of documents that exceed several thousand words . we compare transformer based methods to extractive methods, but extractive models score higher . |
| Approach: | They propose a method to generate abstractive summaries of documents that exceed several thousand words via neural abstractive summary. |
| Outcome: | The proposed method produces abstractive summaries of documents that exceed several thousand words . it is compared with baseline methods, state-of-the-art models and variants of the proposed method . |
Ranking Sentences for Extractive Summarization with Reinforcement Learning (N18-1)
Copied to clipboard
| Challenge: | Abstractive summarization involves various text rewriting operations and has been identified as a sequence-to-sequence problem. |
| Approach: | They propose a novel algorithm which globally optimizes the ROUGE evaluation metric through a reinforcement learning objective. |
| Outcome: | The proposed algorithm outperforms state-of-the-art extractive and abstractive systems when evaluated automatically and by humans. |
Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models to summarize texts without ground-truth summaries are extractive, which remove words from texts and thus are less flexible than abstractive models. |
| Approach: | They propose an unsupervised model that extracts words from texts and makes them mutually enhance each other. |
| Outcome: | The proposed model outperforms both abstractive and extractive models, while generating new words not contained in input texts. |
Long Document Summarization in a Low Resource Setting using Pretrained Language Models (2021.acl-srw)
Copied to clipboard
Ahsaas Bajaj, Pavitra Dangati, Kalpesh Krishna, Pradhiksha Ashok Kumar, Rheeya Uppaal, Bradford Windsor, Eliot Brenner, Dominic Dotterrer, Rajarshi Das, Andrew McCallum
| Challenge: | Existing abstractive summarization methods only achieve 17.9 ROUGE-L in low-resource settings. |
| Approach: | They propose to use a modern abstractive summarization algorithm to extract salient sentences from long documents to improve their performance. |
| Outcome: | The proposed method beats several competitive salience detection baselines and the identified salient sentences agree with independent human labeling by domain experts. |
The Summary Loop: Learning to Write Abstractive Summaries Without Examples (2020.acl-main)
Copied to clipboard
| Challenge: | Unsupervised abstractive summarization is important for news headlines and research papers . a novel method that encourages the inclusion of key terms from the original document into the summary is presented . |
| Approach: | They propose a method that encourages the inclusion of key terms from the original document into the summary by a coverage model along with a fluency model. |
| Outcome: | The proposed method outperforms existing methods on news summarization datasets and is competitive with existing methods. |