Challenge: Existing methods for extracting text summarization are abstractive and extractive.
Approach: They propose a novel approach for extractive summarization by simulating two stages . they adopt a convolutional neural network to encode gist of paragraphs for rough reading .
Outcome: The proposed method significantly outperforms the state-of-the-art extractive methods on CNN and DailyMail datasets.

Similar Papers

Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)

Copied to clipboard

Challenge: Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved.
Approach: They propose to use different types of model architectures to improve extractive summarization systems.
Outcome: The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis.
Extractive Summarization as Text Matching (2020.acl-main)

Copied to clipboard

Challenge: Currently, most of the neural extractive summarization systems score and extract sentences individually and model the relationship between sentences.
Approach: They propose to instantiate a neural extractive summarization task as a semantic text matching problem and use it to match a source document and candidate summaries in a semantic space.
Outcome: The proposed framework is faster and more efficient than existing frameworks.
BanditSum: Extractive Summarization as a Contextual Bandit (D18-1)

Copied to clipboard

Challenge: Existing methods for extractive summarization are heuristically generated and require a set of binary labels to be selected.
Approach: They propose a method for training neural networks to perform single-document extractive summarization without heuristically-generated extractive labels.
Outcome: The proposed method achieves better ROUGE scores than the state-of-the-art methods and significantly fewer update steps than competing approaches.
Neural Document Summarization by Jointly Learning to Score and Select Sentences (P18-1)

Copied to clipboard

Challenge: Sentence scoring and sentence selection are two main steps in extractive document summarization systems.
Approach: They propose an end-to-end neural network framework for extractive document summarization by jointly learning to score and select sentences.
Outcome: The proposed framework outperforms the state-of-the-art summarization models on the CNN/Daily Mail dataset.
What Have We Achieved on Text Summarization? (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for text summarization have been investigated, but there are still gaps between them and human professionals.
Approach: They analyze 8 major sources of errors on 10 representative summarization models manually.
Outcome: Aiming to gain more understanding of summarization systems with respect to their strengths and limitations on a fine-grained syntactic and semantic level, we use 8 major sources of errors on 10 representative summarizing models.
At Which Level Should We Extract? An Empirical Analysis on Extractive Document Summarization (2020.coling-main)

Copied to clipboard

Challenge: Existing studies have shown that extracting sentences at sentence level is not the best solution for document summarization.
Approach: They propose to extract sub-sentential units based on the constituency parsing tree and a neural extractive model which leverages the sub-sensential information and extracts them.
Outcome: The proposed model performs competitively compared to full sentence extraction under automatic and human evaluations.
Content Selection in Deep Learning Models of Summarization (D18-1)

Copied to clipboard

Challenge: Using deep learning models, we find that word embedding does not improve performance over simpler models.
Approach: They propose to use sentence embedding to perform content selection across multiple domains . they propose to propose two alternative models that use auto-regressive sentence extraction .
Outcome: The proposed models improve performance across news, personal stories, meetings, and medical articles.
Neural Extractive Text Summarization with Syntactic Compression (D19-1)

Copied to clipboard

Challenge: Recent approaches to summarization are either selection-based extraction or generation-based abstraction.
Approach: They propose a neural model for single-document summarization based on joint extraction and syntactic compression.
Outcome: The proposed model outperforms an off-the-shelf compression module and its output generally remains grammatical.
Don’t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization (D18-1)

Copied to clipboard

Challenge: Existing approaches to summarize documents are not extractive and require an abstractive approach.
Approach: They propose a novel abstractive model which is conditioned on the article’s topics and based entirely on convolutional neural networks.
Outcome: The proposed model outperforms an oracle extractive system and state-of-the-art abstractive approaches when evaluated automatically and by humans.
Self-Supervised Learning for Contextualized Extractive Summarization (P19-1)

Copied to clipboard

Challenge: Existing models for extractive summarization are usually trained from scratch with a cross-entropy loss . previous work builds an end-to-end system to learn to choose sentences without explicitly modeling document context .
Approach: They propose three auxiliary pre-training tasks that learn to capture the document context in a self-supervised fashion.
Outcome: The proposed models outperform existing models on a CNN/DM dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations