Challenge: Existing methods for summarizing documents neglect the relationships between documents . existing methods treat retrieval and summarization as separate tasks .
Approach: They propose a framework that captures global document relationships through graph-based clustering . this cluster-level thematic information is then used to guide large language models .
Outcome: The proposed framework significantly improves retrieval accuracy and produces better summaries than existing methods.

Similar Papers

Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Multi-document summarization (MDS) assumes a set of topic-related documents is provided as input.
Approach: They formalize the task and bootstrap it using existing datasets, retrievers and summarizers.
Outcome: The proposed method reduces the sensitivity of summarizers to imperfect retrieval, but is highly sensitive to other errors.
Enhancing Multi-Document Summarization with Cross-Document Graph-based Information Extraction (2023.eacl-main)

Copied to clipboard

Challenge: Information extraction (IE) and summarization (summarization) are closely related, but both aims to abstract the most salient information into a generated text summary.
Approach: They propose to use structured IE graphs to enhance the abstractive summarization task by using cross-document IE output to incorporate an alignment loss between IE nodes and their text spans to reduce inconsistencies.
Outcome: The proposed model can generate summaries that are more factual while not losing abstractiveness.
Leveraging Graph to Improve Abstractive Multi-Document Summarization (2020.acl-main)

Copied to clipboard

Challenge: Empirical results show that our model brings substantial improvements over several strong baselines.
Approach: They propose a neural abstractive multi-document summarization model which captures cross-document relations and can guide the summary generation process.
Outcome: The proposed model improves on the WikiSum and MultiNews datasets and can be easily combined with pre-trained language models.
Topic-Guided Abstractive Multi-Document Summarization (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on multi-document summarization (MDS) focus on extractive and abstractive approaches to create a fluent and concise summary for a collection of thematically related documents.
Approach: They propose a novel abstractive MDS model that represents multiple documents as a heterogeneous graph and then applies a graph-to-sequence framework to generate summaries.
Outcome: The proposed model outperforms state-of-the-art models on Rouge scores and human evaluation, while learning high-quality topics.
Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for retrieving historical LLM responses are lacking in long-context summarization tasks.
Approach: They propose a graph of records which leverages historical LLM responses to enhance RAG for long-context global summarization.
Outcome: The proposed method improves on four long-context summarization datasets.
Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Reward (2020.acl-main)

Copied to clipboard

Challenge: Abstractive summarization models for document encoders suffer from fabricated content and are often near-extractive.
Approach: They propose a framework for abstractive summarization with Graph-Augmentation and semantic-driven RewarD that uses a sequential document encoder and a graph-structured encoder to maintain the global context and local characteristics of entities.
Outcome: The proposed framework produces higher ROUGE scores than a variant without knowledge graph on New York Times and CNN/Daily Mail datasets.
GraphLSS: Integrating Lexical, Structural, and Semantic Features for Long Document Extractive Summarization (2025.naacl-short)

Copied to clipboard

Challenge: Graph-based methods for extracting documents have been popular, but they often require external tools or additional machine learning models to define graph components.
Approach: They propose a heterogeneous graph construction for extractive summarization that defines two levels of information and four types of edges without any need for auxiliary learning models.
Outcome: The proposed graph construction outperforms previous graph-based models on two datasets and is available on GitHub.
BASS: Boosting Abstractive Summarization with Unified Semantic Graph (2021.acl-long)

Copied to clipboard

Challenge: Abstractive summarization for long-document or multi-document remains challenging for Seq2Seq as it does not analyze long-distance relations in text.
Approach: They propose a framework for Boosting Abstractive Summarization based on a unified Semantic graph which aggregates co-referent phrases distributing across a long range of context and conveys rich relations between phrases.
Outcome: The proposed framework improves document representation and summary generation process by leveraging the graph structure.
Beyond the Scientific Document: A Citation-Aware Multi-Granular Summarization Approach with Heterogeneous Graphs (2025.findings-emnlp)

Copied to clipboard

Challenge: Experimental results demonstrate that our model outperforms existing approaches for summarizing documents.
Approach: proposed model constructs a heterogeneous graph to represent a document and its relevant external citations.
Outcome: The proposed model outperforms existing models in three different scenarios.
Multi Graph Neural Network for Extractive Long Document Summarization (2022.coling-1)

Copied to clipboard

Challenge: Heterogeneous Graph Neural Networks (GNN) have been proposed as an emergent approach for extracting document summarization (EDS) but there are still limitations in applying it for long documents due to the lack of inter-sentence connections.
Approach: They propose to build a graph on sentence-level nodes and combine it with HeterGNN to capture the semantic information in terms of both inter and intra-sentence connections.
Outcome: Experiments on two datasets show that the proposed method achieves state-of-the-art in this research field.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations