Efficiently Summarizing Text and Graph Encodings of Multi-Document Clusters (2021.naacl-main)
Copied to clipboard
| Challenge: | Abstractive multi-document summarization (MDS) is a task that has seen advances with the introduction of large-scale datasets and powerful Transformer-based models. |
| Approach: | They propose an efficient graph-enhanced approach to multi-document summarization with an encoder-decoder Transformer model. |
| Outcome: | The proposed model scales to large input documents and improves on a multi-document dataset. |
Similar Papers
A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models have been used for abstractive single-document summarization (SDS) but they may not be suitable for multi-document summary (MDS) |
| Approach: | They propose to enforce hierarchy on both encoder and decoder to facilitate multi-document interactions for MDS. |
| Outcome: | Xiao et al. (2019) outperforms or is competitive with the previous best models. |
Transformer-based Model for Single Documents Neural Summarization (D19-56)
Copied to clipboard
| Challenge: | Existing approaches for document summarization use manual feature engineering, integer linear programming and data-driven approaches. |
| Approach: | They propose a framework that encodes the source text first with a transformer, then a sequence-to-sequence model. |
| Outcome: | The proposed framework improves performance on extractive and abstractive document summarization task using the CNN/DailyMail and Newsroom datasets. |
Hierarchical Transformers for Multi-Document Summarization (P19-1)
Copied to clipboard
| Challenge: | Existing models for multidocument summarization have been developed that can process multiple documents in a hierarchical manner. |
| Approach: | They propose a neural summarization model which can process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. |
| Outcome: | The proposed model improves on the WikiSum dataset and can process multiple documents in a hierarchical manner. |
Leveraging Graph to Improve Abstractive Multi-Document Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Empirical results show that our model brings substantial improvements over several strong baselines. |
| Approach: | They propose a neural abstractive multi-document summarization model which captures cross-document relations and can guide the summary generation process. |
| Outcome: | The proposed model improves on the WikiSum and MultiNews datasets and can be easily combined with pre-trained language models. |
Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model (P19-1)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) of news articles has been limited to datasets of a couple of hundred examples. |
| Approach: | They propose a model which integrates a traditional extractive summarization model with a standard SDS model and achieves competitive results on MDS datasets. |
| Outcome: | The proposed model achieves competitive results on large-scale datasets. |
Promoting Topic Coherence and Inter-Document Consorts in Multi-Document Summarization via Simplicial Complex and Sheaf Graph (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that generate summaries from multiple sources often lack accuracy and accuracy due to the length of tokens used in encoding. |
| Approach: | They propose a novel encoder-decoder model that uses pre-trained BART to analyze linguistic nuances, simplicial complex layer to apprehend inherent properties that transcend pairwise associations and sheaf graph attention to effectively capture heterophilic properties. |
| Outcome: | The proposed model achieves consistent performance improvement across all evaluation metrics (syntactical, semantical and faithfulness). |
Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awareness (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to Multi-document summarization are limited due to the extremely long input length. |
| Approach: | They propose an extract-then-abstract Transformer framework to overcome the problem . they leverage pre-trained language models to construct hierarchical extractors and abstractors . |
| Outcome: | The proposed framework outperforms baseline models with comparable model sizes and achieves the best results on the Multi-News, Multi-XScience, and WikiCatSum corpora. |
Topic-Guided Abstractive Multi-Document Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on multi-document summarization (MDS) focus on extractive and abstractive approaches to create a fluent and concise summary for a collection of thematically related documents. |
| Approach: | They propose a novel abstractive MDS model that represents multiple documents as a heterogeneous graph and then applies a graph-to-sequence framework to generate summaries. |
| Outcome: | The proposed model outperforms state-of-the-art models on Rouge scores and human evaluation, while learning high-quality topics. |
Multi-Document Scientific Summarization from a Knowledge Graph-Centric View (2022.coling-1)
Copied to clipboard
| Challenge: | Multi-Document Scientific Summarization (MDSS) aims to produce concise and concise summaries for clusters of topic-relevant scientific papers. |
| Approach: | They propose a model that incorporates knowledge graphs into paper encoding and decoding processes and propose 'decoder' for generating knowledge graph information of summary in the form of descriptive sentences. |
| Outcome: | The proposed architecture improves on baselines on the Multi-Xscience dataset. |
Enhancing Multi-Document Summarization with Cross-Document Graph-based Information Extraction (2023.eacl-main)
Copied to clipboard
| Challenge: | Information extraction (IE) and summarization (summarization) are closely related, but both aims to abstract the most salient information into a generated text summary. |
| Approach: | They propose to use structured IE graphs to enhance the abstractive summarization task by using cross-document IE output to incorporate an alignment loss between IE nodes and their text spans to reduce inconsistencies. |
| Outcome: | The proposed model can generate summaries that are more factual while not losing abstractiveness. |