Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for abstractive summarization use encoder-decoder attention, but this leads to incomplete copying. |
| Approach: | They propose a copying scheme that takes advantage of prior copying distributions and explicitly encourages the model to copy the input word that is relevant to the previously copied one. |
| Outcome: | The proposed scheme achieves state-of-the-art on summarization benchmarks . it takes advantage of prior copying distributions and explicitly encourages copying . |
Similar Papers
Self-Attention Guided Copy Mechanism for Abstractive Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Abstractive summarization models have been widely used to extract words from source into summary, but how to ensure that important words in source are copied remains a challenge. |
| Approach: | They propose a Transformer-based model to enhance copy mechanism by identifying the importance of each source word based on the degree centrality. |
| Outcome: | The proposed model outperforms baseline methods on CNN/Daily Mail and Gigaword datasets. |
Structure-Infused Copy Mechanisms for Abstractive Summarization (C18-1)
Copied to clipboard
| Challenge: | Experimental results show that system summaries struggle to preserve syntactic meaning of source texts. |
| Approach: | They propose to incorporate syntactic information from source sentences into abstractive summaries by structure-infused copy mechanisms. |
| Outcome: | The proposed approach compares favorably to state-of-the-art methods. |
PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing summarization strategies are abstractive and extractive, but are hard to control. |
| Approach: | They propose a PhRase-level cOpying Mechanism that enhances attention on n-grams and calculates an auxiliary loss for the copying prediction. |
| Outcome: | Empirical studies show that PROM improves copying accuracy and faithfulness on benchmarks. |
Multi-Granularity Interaction Network for Extractive and Abstractive Multi-Document Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for document summarization use extractive and abstractive representations, but they don't take into account hierarchical structure of document clusters. |
| Approach: | They propose a multi-granularity interaction network for extractive and abstractive multi-document summarization which jointly learn semantic representations for words, sentences, and documents. |
| Outcome: | The proposed model outperforms baseline methods and achieves the best results on the Multi-News dataset. |
On the Abstractiveness of Neural Document Summarization (D18-1)
Copied to clipboard
| Challenge: | Recent studies show that document summarization systems are abstractive . authors suggest that automated summarizing systems could be improved . |
| Approach: | They propose to use a pure copy system to verify abstractiveness of document summarization systems. |
| Outcome: | The proposed system produces abstractive summaries while being far more efficient. |
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | We present a method to produce abstractive summaries of documents that exceed several thousand words . we compare transformer based methods to extractive methods, but extractive models score higher . |
| Approach: | They propose a method to generate abstractive summaries of documents that exceed several thousand words via neural abstractive summary. |
| Outcome: | The proposed method produces abstractive summaries of documents that exceed several thousand words . it is compared with baseline methods, state-of-the-art models and variants of the proposed method . |
Abstractive Summarizers are Excellent Extractive Summarizers (2023.acl-short)
Copied to clipboard
| Challenge: | Abstractive summarization systems have traditionally been fragmented, limiting the benefits of compatible models. |
| Approach: | They propose three new inference algorithms using sequence-to-sequence architectures to model extractive summarization with an abstractive summmarization system. |
| Outcome: | The proposed algorithms outperform existing models on CNN and Dailymail and show that they are more efficient than existing models. |
Deep Copycat Networks for Text-to-Text Generation (D19-1)
Copied to clipboard
| Challenge: | Text-to-text generation tasks require copying words from the input to the output. |
| Approach: | They propose a transformer-based pointer network for text-to-text generation which generates more abstractive summaries and a further extension of this architecture for automatic post-editing. |
| Outcome: | The proposed model outperforms existing models in text-to-text generation tasks and improves translation accuracy. |
Concept Pointer Network for Abstractive Summarization (D19-1)
Copied to clipboard
| Challenge: | Abstractive summarization (ABS) has gained overwhelming success owing to a tremendous development of sequence-to-sequence models and its variants. |
| Approach: | They propose a concept pointer network that leverages knowledge-based, context-aware conceptualizations to derive an extended set of candidate concepts and then points to the most appropriate choice using both the concept set and original source text. |
| Outcome: | The proposed model improves on the DUC-2004 and Gigaword datasets and human evaluation of its abstractive abilities supports the quality of the summaries produced. |
Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)
Copied to clipboard
| Challenge: | Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved. |
| Approach: | They propose to use different types of model architectures to improve extractive summarization systems. |
| Outcome: | The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis. |