Learning to Fuse Sentences with Transformers for Summarization (2020.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive summarization systems that fuse sentences are not rewarded for correctly fusing sentences. |
| Approach: | They propose to leverage the knowledge of points of correspondence between sentences to enhance their ability to fuse sentences. |
| Outcome: | The proposed algorithms improve the ability of the proposed summarization systems to fuse sentences and show that they can fuse sentences in a way that retains the original meaning. |
Similar Papers
Analyzing Sentence Fusion in Abstractive Summarization (D19-54)
Copied to clipboard
Logan Lebanoff, John Muchovej, Franck Dernoncourt, Doo Soon Kim, Seokhwan Kim, Walter Chang, Fei Liu
| Challenge: | Abstractive summarization systems struggle to combine information from multiple sources, resulting in poor grammar and incorrect facts. |
| Approach: | They analyze the outputs of five abstractive summarization systems and examine their grammatical accuracy and faithfulness. |
| Outcome: | The proposed summarization systems are able to combine information from multiple sources, but they often fail to remain faithful to the original document. |
Understanding Points of Correspondence between Sentences for Abstractive Summarization (2020.acl-srw)
Copied to clipboard
| Challenge: | Using points of correspondence, fusion systems are difficult for abstractive summarizers because of their complexity. |
| Approach: | They propose to model points of correspondence between disparate sentences by combining documents, source and fusion sentences, and human annotations of points of correspondance between sentences. |
| Outcome: | The proposed model bridges the gap between coreference resolution and summarization by using human annotations of points of correspondence between sentences. |
Semantically Driven Sentence Fusion: Modeling and Evaluation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Sentence fusion is the task of joining related sentences into coherent text. |
| Approach: | They propose a method where ground-truth solutions are automatically expanded into multiple references via curated equivalence classes of connective phrases. |
| Outcome: | The proposed approach improves on state-of-the-art models by expanding ground-truth solutions into multiple references. |
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for document summarization use graphs and unlabeled documents . Existing models require labeled data, and it is expensive to create summarized documents. |
| Approach: | They propose to rank sentences using transformer attentions and pre-training objectives by unlabeled documents. |
| Outcome: | The proposed model achieves state-of-the-art on unsupervised summarization and is less dependent on sentence positions. |
DiscoFuse: A Large-Scale Dataset for Discourse-Based Sentence Fusion (N19-1)
Copied to clipboard
| Challenge: | Existing datasets for sentence fusion are small and insufficient for training modern neural models. |
| Approach: | They propose a method for automatically-generating fusion examples from raw text . they apply their method to Wikipedia and Sports articles to generate fusion models . |
| Outcome: | The proposed method improves performance on WebSplit when viewed as a sentence fusion task. |
Deep Differential Amplifier for Extractive Summarization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to extract summary from document with a disproportionate ratio of selected and unselected sentences are far from human performance. |
| Approach: | They propose a model that rebalances sentence-level extractive summarization by amplifying the semantic difference between each sentence and all other sentences and applying the residual unit as the second item of the differential amplifier to deepen the architecture. |
| Outcome: | The proposed model performs competitively against state-of-the-art methods on two benchmark datasets. |
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | We present a method to produce abstractive summaries of documents that exceed several thousand words . we compare transformer based methods to extractive methods, but extractive models score higher . |
| Approach: | They propose a method to generate abstractive summaries of documents that exceed several thousand words via neural abstractive summary. |
| Outcome: | The proposed method produces abstractive summaries of documents that exceed several thousand words . it is compared with baseline methods, state-of-the-art models and variants of the proposed method . |
Scoring Sentence Singletons and Pairs for Abstractive Summarization (P19-1)
Copied to clipboard
Logan Lebanoff, Kaiqiang Song, Franck Dernoncourt, Doo Soon Kim, Seokhwan Kim, Walter Chang, Fei Liu
| Challenge: | Existing methods for summarizing content from single sentences are inadequately understood. |
| Approach: | They propose to combine singletons and pairs to create a summarizing sentence . they use a dataset of human-written abstracts to examine human-writing methods . |
| Outcome: | The proposed framework is based on human-written abstracts from three large datasets. |
Hierarchical Transformers for Multi-Document Summarization (P19-1)
Copied to clipboard
| Challenge: | Existing models for multidocument summarization have been developed that can process multiple documents in a hierarchical manner. |
| Approach: | They propose a neural summarization model which can process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. |
| Outcome: | The proposed model improves on the WikiSum dataset and can process multiple documents in a hierarchical manner. |
Inference Time Style Control for Summarization (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to generate summaries of different styles without training separate models are lacking parallel data and expensive (re)training. |
| Approach: | They propose two methods that can be deployed during summary decoding on any pre-trained Transformer-based summarization model. |
| Outcome: | The proposed methods generate news headlines with various ideological leanings while still informative. |