Separating Context and Pattern: Learning Disentangled Sentence Representations for Low-Resource Extractive Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Context information is one of the key factors for extractive summarization, but other factors can be used to identify sentence importance. |
| Approach: | They propose to disentangle context and pattern factors for extractive summarization . they separate context and patterns for a better generalization ability in low-resource setting . |
| Outcome: | The proposed model can be used in the zero-shot setting or fine-tuned in the few-shot settings. |
Similar Papers
A Set Prediction Network For Extractive Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent approaches to extracting salient sentences from source document are naive and lack dependencies between sentences. |
| Approach: | They propose a set prediction network to detect redundancy relationship between sentences . they use a non-autoregressive decoder to predict sentences in parallel . |
| Outcome: | The proposed method outperforms previous state-of-the-art models on extracted summary datasets. |
SumTitles: a Summarization Dataset with Low Extractiveness (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for extractive summarization of dialogue data are limited by the grammar and structure of the utterances used. |
| Approach: | They propose a low-extractive corpus of movie dialogues for abstractive text summarization . they use an alignment algorithm to construct the corpus and a baseline evaluation . |
| Outcome: | The proposed method is low-extractive and shows high performance in dialogue datasets. |
Simple Unsupervised Summarization by Contextual Matching (P19-1)
Copied to clipboard
| Challenge: | Existing methods for sentence summarization require a large amount of parallel data for supervision to work. |
| Approach: | They propose an unsupervised method for sentence summarization using only language modeling. |
| Outcome: | The proposed method maintains continuous contextual matching while maintaining output fluency without any paired examples. |
Self-Supervised Learning for Contextualized Extractive Summarization (P19-1)
Copied to clipboard
| Challenge: | Existing models for extractive summarization are usually trained from scratch with a cross-entropy loss . previous work builds an end-to-end system to learn to choose sentences without explicitly modeling document context . |
| Approach: | They propose three auxiliary pre-training tasks that learn to capture the document context in a self-supervised fashion. |
| Outcome: | The proposed models outperform existing models on a CNN/DM dataset. |
Extractive Summarization as Text Matching (2020.acl-main)
Copied to clipboard
| Challenge: | Currently, most of the neural extractive summarization systems score and extract sentences individually and model the relationship between sentences. |
| Approach: | They propose to instantiate a neural extractive summarization task as a semantic text matching problem and use it to match a source document and candidate summaries in a semantic space. |
| Outcome: | The proposed framework is faster and more efficient than existing frameworks. |
Exploiting Discourse-Level Segmentation for Extractive Summarization (D19-54)
Copied to clipboard
| Challenge: | Existing approaches to extract summarize text are based on sentences as the elementary unit, but semantic segments containing supplementary information or descriptive details are often nonessential in the generated summaries. |
| Approach: | They propose to exploit discourse-level segmentation as a finer-grained means to more precisely pinpoint the core content in a document. |
| Outcome: | The proposed method improves extractive summarization performance on CNN/Daily Mail dataset. |
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for document summarization use graphs and unlabeled documents . Existing models require labeled data, and it is expensive to create summarized documents. |
| Approach: | They propose to rank sentences using transformer attentions and pre-training objectives by unlabeled documents. |
| Outcome: | The proposed model achieves state-of-the-art on unsupervised summarization and is less dependent on sentence positions. |
Neural Latent Extractive Document Summarization (D18-1)
Copied to clipboard
| Challenge: | Existing summarization paradigms focus on extractive summarizing based on sentence level labels . |
| Approach: | They propose a latent variable extractive model where sentences are viewed as latent variables and sentences with activated variables are used to infer gold summaries. |
| Outcome: | The proposed model outperforms a strong extractive baseline trained on rule-based labels and performs competitively with several recent models. |
Low-Resource Dialogue Summarization with Domain-Agnostic Multi-Source Pretraining (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for low-resource dialogue summarization neglect the difference between dialogues and conventional articles. |
| Approach: | They propose a multi-source pretraining paradigm to leverage external summary data . they exploit large-scale in-domain non-summary data to separate dialogue encoder and summary decoder . |
| Outcome: | The proposed model can be used to better leverage external summary data. |
Neural Document Summarization by Jointly Learning to Score and Select Sentences (P18-1)
Copied to clipboard
| Challenge: | Sentence scoring and sentence selection are two main steps in extractive document summarization systems. |
| Approach: | They propose an end-to-end neural network framework for extractive document summarization by jointly learning to score and select sentences. |
| Outcome: | The proposed framework outperforms the state-of-the-art summarization models on the CNN/Daily Mail dataset. |