| Challenge: | Abstractive text summarization models separate the salience detection phase from the text generation phase. |
| Approach: | They propose to formalize Controlled Text Reduction as a standalone task . they advocate the potential of such models for modular fully-automatic summarization . |
| Outcome: | The proposed model shows that it is possible to produce a reduced version of a source text using decomposed modeling. |
Similar Papers
Don’t Add, don’t Miss: Effective Content Preserving Generation from Pre-Selected Text Spans (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing CTR models are mediocre and lack reliable performance . authors propose an explicit decomposition of these two subtasks into a single task . |
| Approach: | They propose an isolated task that challenges models to generate coherent text conforming to pre-selected content within the input text ("highlights") authors propose a high-quality, open-source CTR model that tackles two prior key limitations: inadequate enforcement of the content-preservation constraint, and suboptimal silver training data. |
| Outcome: | The proposed model significantly improves silver training data quality over the existing model, with up to 30 ROUGE-L points. |
Multi-Review Fusion-in-Context (2024.findings-naacl)
Copied to clipboard
| Challenge: | Current methods for generating text are opaque and difficult to control and interpret due to their opaque nature. |
| Approach: | They propose a modular approach with separate components for each step . they formalize Fusion-in-Context as a standalone task, whose input consists of source texts with highlighted spans of targeted content. |
| Outcome: | The proposed approach is based on a curated dataset of 1000 instances in the reviews domain and a novel evaluation framework for assessing the faithfulness and coverage of highlights. |
Learning to Prioritize: Precision-Driven Sentence Filtering for Long Text Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Neural text summarization models are limited by their maximum input length, posing a challenge to summarizing longer texts comprehensively. |
| Approach: | They propose a pre-processing layer that removes low-quality sentences in articles to improve existing summarization models. |
| Outcome: | The proposed approach improves state-of-the-art summarization models on WikiHow and Reddit TIFU datasets by 3.84 and 8.57 points on the full test set and the long article subset. |
Better Highlighting: Creating Sub-Sentence Summary Highlights (2020.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive summarizations are considered to be less reliable because they distort the original meaning and can be confusing for readers. |
| Approach: | They propose a method to generate summary highlights that are understandable on their own to avoid confusion. |
| Outcome: | The proposed method allows summaries to be understood in context and avoids misdirecting readers to false conclusions. |
CTRLsum: Towards Generic Controllable Text Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing summarization systems produce generic summaries that are disconnected from users’ preferences and expectations. |
| Approach: | They propose a generic framework to control generated summaries through a set of keywords. |
| Outcome: | The proposed framework is comparable or better than strong pretrained systems on three domains of summarization datasets and five control tasks. |
Effective Crowdsourcing for a New Type of Summarization Task (N18-2)
Copied to clipboard
| Challenge: | Currently, summarization research focuses on summarizing the entire text, but in practice, readers are often interested in only one aspect of the document or conversation. |
| Approach: | They propose a new task where the goal is to summarize a particular aspect of a document. |
| Outcome: | The proposed task is based on a crowdsourced data collection workflow that allows users to collect high-quality summaries. |
Bottom-Up Abstractive Summarization (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to summarize text using end-to-end content selectors have had mixed success in content selection, for example copying full sentences from the source document. |
| Approach: | They propose to use content selectors to over-determine phrases in a source document that should be part of the summary. |
| Outcome: | The proposed model over-determines phrases in a source document that should be part of the summary while generating fluent summaries. |
Controlling the Focus of Pretrained Language Generation Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing mechanisms to control the model's focus are not available for pretrained transformer-based language generation models. |
| Approach: | They propose to augment a pretrained model with trainable "focus vectors" that are directly applied to the model's embeddings while the model itself is kept fixed. |
| Outcome: | The proposed model is able to generate relevant outputs from user-selected highlights while keeping the model fixed. |
Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects - A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | scholarly attention has turned to the development of text summarization methods that are more closely tailored and controlled to align with specific objectives and user needs. |
| Approach: | They formalize a controllable text summarization task and categorize controllability attributes according to their shared characteristics and objectives. |
| Outcome: | The proposed method is tailored to meet the specific intent and needs of users. |
Pre-training for Abstractive Document Summarization by Reinstating Source Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive document summarization models are often trained on limited supervised data . authors present three objectives for pretraining abstractive summarizing models . |
| Approach: | They propose to pre-train a SEQ2SEQ based abstractive summarization model on unlabeled text. |
| Outcome: | The proposed method improves on two benchmark summarization datasets with 19GB of text . the goal is sentence reordering, next sentence generation and masked document generation . |