Scaling Multi-Document Event Summarization: Evaluating Compression vs. Full-Text Approaches (2025.naacl-short)
Copied to clipboard
| Challenge: | Summarizing large text collections is a valuable tool for document research . a multi-stage pipeline and lack of global context are challenges for large-scale summarization systems. |
| Approach: | They compare compression and full-text systems for large-scale multi-document summarization . they find that compression-based methods outperform full-context methods . |
| Outcome: | The proposed methods outperform compression-based methods on three datasets . however, they suffer information loss due to their multi-stage pipeline and lack of global context. |
Similar Papers
A Large-Scale Multi-Document Summarization Dataset from the Wikipedia Current Events Portal (2020.acl-main)
Copied to clipboard
| Challenge: | Multidocument summarization (MDS) aims to compress large document collections into short summaries. |
| Approach: | They propose a large-scale multidocument summarization dataset that is large both in total number of document clusters and in the size of individual clusters. |
| Outcome: | The proposed dataset is large both in the total number of document clusters and in the size of individual clusters. |
Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) assumes a set of topic-related documents is provided as input. |
| Approach: | They formalize the task and bootstrap it using existing datasets, retrievers and summarizers. |
| Outcome: | The proposed method reduces the sensitivity of summarizers to imperfect retrieval, but is highly sensitive to other errors. |
Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model (P19-1)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) of news articles has been limited to datasets of a couple of hundred examples. |
| Approach: | They propose a model which integrates a traditional extractive summarization model with a standard SDS model and achieves competitive results on MDS datasets. |
| Outcome: | The proposed model achieves competitive results on large-scale datasets. |
How “Multi” is Multi-Document Summarization? (2022.emnlp-main)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) aims at combining information spread across multiple documents . a single document often covers the full summary content . |
| Approach: | They propose a measure to evaluate the degree to which a summary is "disperse" they propose to combine information from multiple documents into a single document to generate a concise summary . |
| Outcome: | The proposed measure evaluates the degree to which a summary is "disperse" the measure is applied to several popular MDS datasets and state-of-the-art systems. |
MDS: A Fine-Grained Dataset for Multi-Modal Dialogue Summarization (2024.lrec-main)
Copied to clipboard
| Challenge: | Summarizing the dialogue into a short message has drawn much attention due to the explosion of various dialogue scenes. |
| Approach: | They develop a multi-modal dialogue summarization dataset to enhance the variety of data available for this research area. |
| Outcome: | The proposed dataset provides a demanding testbed for multi-modal dialogue summarization. |
Corpora Evaluation and System Bias Detection in Multi-document Summarization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) is a task of combining multiple documents into a concise text paragraph. |
| Approach: | They propose to use a multi-document summarization task to reflect key points from any set of documents into a concise text paragraph. |
| Outcome: | The proposed system performs better on a set of selected datasets than on the other ones. |
An Empirical Study on Topic Preservation in Multi-Document Summarization (2022.aacl-srw)
Copied to clipboard
| Challenge: | Multi-document summarization is a process of generating an informative and concise summary from multiple topic-related documents. |
| Approach: | They perform empirical analysis on two MDS datasets and study topic preservation on generated summaries from 8 MDS models. |
| Outcome: | The results show that extractive and abstractive summarization methods preserve topic information from source documents. |
Multi Document Summarization Evaluation in the Presence of Damaging Content (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing metrics evaluate a summary based on relevance and consistency with the source documents. |
| Approach: | They propose to measure the ability of MDS systems to handle damaging documents in their input set by lexical similarity and language model likelihood. |
| Outcome: | The proposed metrics show that they can summarize a set of documents without damaging content. |
MM-AVS: A Full-Scale Dataset for Multi-modal Summarization (2021.naacl-main)
Copied to clipboard
| Challenge: | Multimodal summarization materials lacking a holistic organization by integrating resources from various modalities. |
| Approach: | They propose a multimodal article and video summarization dataset that integrates resources from different modalities. |
| Outcome: | The proposed dataset validates the important assistance role of external information for multimodal summarization. |
SummN: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents (2022.acl-long)
Copied to clipboard
Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang
| Challenge: | Existing methods to handle long text are limited due to time and memory complexity and limited input lengths. |
| Approach: | They propose a multi-stage split-then-summarize framework for long input summarization . their framework can process input text of arbitrary length by adjusting the number of stages . |
| Outcome: | The proposed framework outperforms existing methods on three long meeting summarization datasets and on a long document summarizing dataset. |