Neural Latent Extractive Document Summarization (D18-1)

Copied to clipboard

Challenge: Existing summarization paradigms focus on extractive summarizing based on sentence level labels .
Approach: They propose a latent variable extractive model where sentences are viewed as latent variables and sentences with activated variables are used to infer gold summaries.
Outcome: The proposed model outperforms a strong extractive baseline trained on rule-based labels and performs competitively with several recent models.

Similar Papers

Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)

Copied to clipboard

Challenge: Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved.
Approach: They propose to use different types of model architectures to improve extractive summarization systems.
Outcome: The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis.
Document Summarization with Latent Queries (2022.tacl-1)

Copied to clipboard

Challenge: Existing benchmarks for query-focused summarization are small for training large neural models.
Approach: They propose a unified modeling framework for query-focused summarization . they model queries as discrete latent variables over document tokens .
Outcome: The proposed framework outperforms strong comparison systems across benchmarks, query types, document settings, and target domains.
Exploiting Discourse-Level Segmentation for Extractive Summarization (D19-54)

Copied to clipboard

Challenge: Existing approaches to extract summarize text are based on sentences as the elementary unit, but semantic segments containing supplementary information or descriptive details are often nonessential in the generated summaries.
Approach: They propose to exploit discourse-level segmentation as a finer-grained means to more precisely pinpoint the core content in a document.
Outcome: The proposed method improves extractive summarization performance on CNN/Daily Mail dataset.
Neural Document Summarization by Jointly Learning to Score and Select Sentences (P18-1)

Copied to clipboard

Challenge: Sentence scoring and sentence selection are two main steps in extractive document summarization systems.
Approach: They propose an end-to-end neural network framework for extractive document summarization by jointly learning to score and select sentences.
Outcome: The proposed framework outperforms the state-of-the-art summarization models on the CNN/Daily Mail dataset.
Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networks (2020.coling-main)

Copied to clipboard

Challenge: Existing extractive summarization models hardly capture inter-sentence relationships, especially in long documents.
Approach: They propose to use a graph neural network to capture inter-sentence relationships efficiently via graph-structured document representation.
Outcome: The proposed model outperforms existing models on CNN/DM and NYT datasets and significantly outperfies them on longer documents.
Neural Extractive Text Summarization with Syntactic Compression (D19-1)

Copied to clipboard

Challenge: Recent approaches to summarization are either selection-based extraction or generation-based abstraction.
Approach: They propose a neural model for single-document summarization based on joint extraction and syntactic compression.
Outcome: The proposed model outperforms an off-the-shelf compression module and its output generally remains grammatical.
Jointly Extracting and Compressing Documents with Summary State Representations (N19-1)

Copied to clipboard

Challenge: Text summarization is an important NLP problem with a wide range of applications in data-driven industries.
Approach: They propose a neural model that extracts sentences from a document and compresses them.
Outcome: The proposed model generates concise and informa-tive summaries on CNN/DailyMail and Newsroom datasets and human evaluations show it outperforms existing methods.
Self-Supervised Learning for Contextualized Extractive Summarization (P19-1)

Copied to clipboard

Challenge: Existing models for extractive summarization are usually trained from scratch with a cross-entropy loss . previous work builds an end-to-end system to learn to choose sentences without explicitly modeling document context .
Approach: They propose three auxiliary pre-training tasks that learn to capture the document context in a self-supervised fashion.
Outcome: The proposed models outperform existing models on a CNN/DM dataset.
At Which Level Should We Extract? An Empirical Analysis on Extractive Document Summarization (2020.coling-main)

Copied to clipboard

Challenge: Existing studies have shown that extracting sentences at sentence level is not the best solution for document summarization.
Approach: They propose to extract sub-sentential units based on the constituency parsing tree and a neural extractive model which leverages the sub-sensential information and extracts them.
Outcome: The proposed model performs competitively compared to full sentence extraction under automatic and human evaluations.
Extractive Summarization of Long Documents by Combining Global and Local Context (D19-1)

Copied to clipboard

Challenge: Existing methods for extractive and abstractive summarization are far from human performance.
Approach: They propose a neural single-document extractive summarization model for long documents that incorporates both the global context of the whole document and the local context.
Outcome: The proposed model outperforms previous models on ROUGE-1, ROUGEE-2 and METEOR scores on two datasets of scientific papers.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations