Challenge: Recent studies on single-document summarization (SDS) benefit from advances in neural sequence learning, but they produce unsatisfactory results on multi-document summary (MDS).
Approach: They propose a neural sequence learning method that unifies advanced neural SDS methods and statistical measures used in classical MDS.
Outcome: The proposed method achieves state-of-the-art performance on benchmark MDS datasets.

Similar Papers

Topic-Guided Reinforcement Learning with LLMs for Enhancing Multi-Document Summarization (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown impressive results in single-document summarization, but their performance on MDS still leaves room for improvement.
Approach: They propose a topic-guided reinforcement learning approach to improve content selection in MDS . explicit prompting models with topic labels enhances the informativeness, they show .
Outcome: The proposed method outperforms baselines on multi-News and multi-XScience datasets.
A Multi-Document Coverage Reward for RELAXed Multi-Document Summarization (2022.acl-long)

Copied to clipboard

Challenge: Multi-document summarization models are limited by limited references and with maximum-likelihood objectives.
Approach: They propose to fine-tune an MDS baseline with a reward that balances a reference-based metric such as ROUGE with coverage of the input documents.
Outcome: The proposed model improves on the Multi-News and WCEP datasets with a low-variance estimator . the proposed model also improves the coverage of the input documents .
Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Multi-document summarization (MDS) assumes a set of topic-related documents is provided as input.
Approach: They formalize the task and bootstrap it using existing datasets, retrievers and summarizers.
Outcome: The proposed method reduces the sensitivity of summarizers to imperfect retrieval, but is highly sensitive to other errors.
Topic-Guided Abstractive Multi-Document Summarization (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on multi-document summarization (MDS) focus on extractive and abstractive approaches to create a fluent and concise summary for a collection of thematically related documents.
Approach: They propose a novel abstractive MDS model that represents multiple documents as a heterogeneous graph and then applies a graph-to-sequence framework to generate summaries.
Outcome: The proposed model outperforms state-of-the-art models on Rouge scores and human evaluation, while learning high-quality topics.
Multi-Dimensional Optimization for Text Summarization via Reinforcement Learning (2024.acl-long)

Copied to clipboard

Challenge: Existing summarization methods target a specific dimension, resulting in poor quality summaries.
Approach: They propose multi-objective reinforcement learning tailored to generate balanced summaries across all dimensions.
Outcome: The proposed model achieves significant performance gains compared to baseline models on representative summarization datasets on four dimensions.
WSL-DS: Weakly Supervised Learning with Distant Supervision for Query Focused Multi-Document Abstractive Summarization (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to generate abstractive summarizations are lacking labeled training datasets.
Approach: They propose a weakly supervised approach to generate a strong summary from a set of documents based on a query.
Outcome: The proposed approach sets a new state-of-the-art in terms of evaluation metrics on the Document Understanding Conferences dataset.
Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model (P19-1)

Copied to clipboard

Challenge: Multi-document summarization (MDS) of news articles has been limited to datasets of a couple of hundred examples.
Approach: They propose a model which integrates a traditional extractive summarization model with a standard SDS model and achieves competitive results on MDS datasets.
Outcome: The proposed model achieves competitive results on large-scale datasets.
Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awareness (2022.naacl-main)

Copied to clipboard

Challenge: Existing approaches to Multi-document summarization are limited due to the extremely long input length.
Approach: They propose an extract-then-abstract Transformer framework to overcome the problem . they leverage pre-trained language models to construct hierarchical extractors and abstractors .
Outcome: The proposed framework outperforms baseline models with comparable model sizes and achieves the best results on the Multi-News, Multi-XScience, and WikiCatSum corpora.
Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement Learning (2023.emnlp-main)

Copied to clipboard

Challenge: Query-focused Summarization (QfS) is a system that generates summaries from document(s) based on a query.
Approach: They propose a Query-focused Summarization approach that uses a generalization of Reinforcement Learning (RL) for Natural Language Generation and a better semantic similarity reward.
Outcome: The proposed approach improves on the ROUGE-L metric and in a benchmark dataset.
Ranking Sentences for Extractive Summarization with Reinforcement Learning (N18-1)

Copied to clipboard

Challenge: Abstractive summarization involves various text rewriting operations and has been identified as a sequence-to-sequence problem.
Approach: They propose a novel algorithm which globally optimizes the ROUGE evaluation metric through a reinforcement learning objective.
Outcome: The proposed algorithm outperforms state-of-the-art extractive and abstractive systems when evaluated automatically and by humans.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations