Challenge: Abstractive text summarization models are hard to be controlled in the process of generation, which leads to a lack of key information.
Approach: They propose a guiding generation model that combines extractive and abstractive methods to generate text summarization.
Outcome: The proposed model improves on the CNN/Daily Mail dataset.

Similar Papers

Guided Neural Language Generation for Abstractive Summarization using Abstract Meaning Representation (D18-1)

Copied to clipboard

Challenge: Recent work on abstractive summarization has made progress with neural encoder-decoder architectures, but these models lack explicit semantic modeling of the source document and its summary.
Approach: They extend previous work on abstractive summarization using Abstract Meaning Representation (AMR) with a neural language generation stage which they guide using the source document.
Outcome: The proposed approach improves summarization performance by 7.4 and 10.5 points in ROUGE-2 using gold standard AMR parses and parses obtained from an off-the-shelf parser respectively.
Abstractive Text Summarization Based on Deep Learning and Semantic Content Generalization (P19-1)

Copied to clipboard

Challenge: Abstractive text summarization is a demanding, time expensive and generally laborious task.
Approach: They propose a framework for enhancing abstractive text summarization using deep learning techniques and semantic data transformations.
Outcome: The proposed method is evaluated on two popular datasets with encouraging results.
Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (2021.acl-long)

Copied to clipboard

Challenge: Abstractive summarization models have made great strides in recent years, but little is known about how they actually form summaries and how to understand where their decisions come from.
Approach: They propose a two-step method to interpret summarization model decisions by categorizing each decoder decision into one of several generation modes.
Outcome: The proposed method can identify phrases the summarization model has memorized and determine where in the training pipeline this memorization happened, and study complex generation phenomena on a per-instance basis.
Leveraging Graph to Improve Abstractive Multi-Document Summarization (2020.acl-main)

Copied to clipboard

Challenge: Empirical results show that our model brings substantial improvements over several strong baselines.
Approach: They propose a neural abstractive multi-document summarization model which captures cross-document relations and can guide the summary generation process.
Outcome: The proposed model improves on the WikiSum and MultiNews datasets and can be easily combined with pre-trained language models.
Extractive Summarization with Text Generator (2024.naacl-long)

Copied to clipboard

Challenge: Existing extractive systems lack gold training signals, thereby hindering learning of extractive models.
Approach: They propose to use text generators to train extractive summarizers by approximating outputs of abstractive summaries.
Outcome: The proposed method can be used to train extractive summarizers without training . it is shown that the approximated summaries correlate positively with the auxiliary summary outputs.
GSum: A General Framework for Guided Neural Abstractive Summarization (2021.naacl-main)

Copied to clipboard

Challenge: Abstractive summarization models are flexible, but they can be difficult to control.
Approach: They propose a general and extensible guided summarization framework that takes different kinds of guidance as input and perform experiments across different varieties.
Outcome: The proposed framework can generate more faithful summaries and different types of guidance generate qualitatively different summary.
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents (N18-2)

Copied to clipboard

Challenge: Existing abstractive summarization models focus on summarizing sentences and short documents.
Approach: They propose a hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary.
Outcome: The proposed model significantly outperforms state-of-the-art models on two large-scale datasets of scientific papers.
Abstractive Text-Image Summarization Using Multi-Modal Attentional Hierarchical RNN (D18-1)

Copied to clipboard

Challenge: Recent research shows the strength of the Encoder-Decoder model in text summarization.
Approach: They propose to use the attentional hierarchical Encoder-Decoder model to summarize a text document and its accompanying images simultaneously and then to align the sentences and images in summaries.
Outcome: The proposed model outperforms the existing methods that do not consider images . it can generate informative summaries of images, and it can be used to summarize documents .
Unsupervised Semantic Abstractive Summarization (P18-3)

Copied to clipboard

Challenge: Existing methods for abstractive summarization are limited in the sense that they can never generate human level summaries for large and complicated documents.
Approach: They propose a pipeline for automatic abstractive summary generation using co-reference resolution and Meta Nodes.
Outcome: The proposed pipeline outperforms the state-of-the-art method by 1.7% in node prediction.
On the Abstractiveness of Neural Document Summarization (D18-1)

Copied to clipboard

Challenge: Recent studies show that document summarization systems are abstractive . authors suggest that automated summarizing systems could be improved .
Approach: They propose to use a pure copy system to verify abstractiveness of document summarization systems.
Outcome: The proposed system produces abstractive summaries while being far more efficient.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations