A Multi-Document Coverage Reward for RELAXed Multi-Document Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Multi-document summarization models are limited by limited references and with maximum-likelihood objectives. |
| Approach: | They propose to fine-tune an MDS baseline with a reward that balances a reference-based metric such as ROUGE with coverage of the input documents. |
| Outcome: | The proposed model improves on the Multi-News and WCEP datasets with a low-variance estimator . the proposed model also improves the coverage of the input documents . |
Similar Papers
Multi-Reward Reinforced Summarization with Saliency and Entailment (N18-2)
Copied to clipboard
| Challenge: | Abstractive text summarization is the task of compressing and rewriting a long document into a short summary while maintaining saliency, directed logical entailment, and non-redundancy. |
| Approach: | They propose a novel reward function for ROUGESal and Entail to improve abstractive summarization . they use a coverage-based reward function to combine ROUGE and En Tail . |
| Outcome: | The proposed method achieves state-of-the-art results on CNN/Daily Mail dataset and strong improvements in a test-only transfer setup on DUC-2002. |
Topic-Guided Reinforcement Learning with LLMs for Enhancing Multi-Document Summarization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown impressive results in single-document summarization, but their performance on MDS still leaves room for improvement. |
| Approach: | They propose a topic-guided reinforcement learning approach to improve content selection in MDS . explicit prompting models with topic labels enhances the informativeness, they show . |
| Outcome: | The proposed method outperforms baselines on multi-News and multi-XScience datasets. |
Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) assumes a set of topic-related documents is provided as input. |
| Approach: | They formalize the task and bootstrap it using existing datasets, retrievers and summarizers. |
| Outcome: | The proposed method reduces the sensitivity of summarizers to imperfect retrieval, but is highly sensitive to other errors. |
Multi-document Summarization with Maximal Marginal Relevance-guided Reinforcement Learning (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies on single-document summarization (SDS) benefit from advances in neural sequence learning, but they produce unsatisfactory results on multi-document summary (MDS). |
| Approach: | They propose a neural sequence learning method that unifies advanced neural SDS methods and statistical measures used in classical MDS. |
| Outcome: | The proposed method achieves state-of-the-art performance on benchmark MDS datasets. |
Multi-Dimensional Optimization for Text Summarization via Reinforcement Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Existing summarization methods target a specific dimension, resulting in poor quality summaries. |
| Approach: | They propose multi-objective reinforcement learning tailored to generate balanced summaries across all dimensions. |
| Outcome: | The proposed model achieves significant performance gains compared to baseline models on representative summarization datasets on four dimensions. |
Multi-Document Summarization with Centroid-Based Pretraining (2023.acl-short)
Copied to clipboard
| Challenge: | In Multi-Document Summarization, the input is a set of documents, and the output is its summary. |
| Approach: | They propose a novel pretraining objective that uses the ROUGE-based centroid of each document cluster as a proxy for its summary. |
| Outcome: | The proposed model is better or comparable to state-of-the-art models. |
Better Rewards Yield Better Summaries: Learning to Summarise Without References (D19-1)
Copied to clipboard
| Challenge: | Reinforcement Learning (RL)-based document summarisation systems produce state-of-the-art performance in terms of ROUGE scores, but high summaries receive low human judgement. |
| Approach: | They propose to learn a reward function from human ratings on 2,500 summaries to generate human-appealing summary. |
| Outcome: | The proposed reward function can generate human-appealing summaries without reference summary input. |
PELMS: Pre-training for Effective Low-Shot Multi-Document Summarization (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for abstractive multi-document summarization fail to generate concise, reflective summaries. |
| Approach: | They propose a pre-trained abstractive multi-document summarization model that uses unlabeled multi-doctoral inputs to generate concise, reflective summaries. |
| Outcome: | The proposed model outperforms competing models on a wide range of MDS datasets. |
Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awareness (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to Multi-document summarization are limited due to the extremely long input length. |
| Approach: | They propose an extract-then-abstract Transformer framework to overcome the problem . they leverage pre-trained language models to construct hierarchical extractors and abstractors . |
| Outcome: | The proposed framework outperforms baseline models with comparable model sizes and achieves the best results on the Multi-News, Multi-XScience, and WikiCatSum corpora. |
Multi Document Summarization Evaluation in the Presence of Damaging Content (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing metrics evaluate a summary based on relevance and consistency with the source documents. |
| Approach: | They propose to measure the ability of MDS systems to handle damaging documents in their input set by lexical similarity and language model likelihood. |
| Outcome: | The proposed metrics show that they can summarize a set of documents without damaging content. |