A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models have been used for abstractive single-document summarization (SDS) but they may not be suitable for multi-document summary (MDS) |
| Approach: | They propose to enforce hierarchy on both encoder and decoder to facilitate multi-document interactions for MDS. |
| Outcome: | Xiao et al. (2019) outperforms or is competitive with the previous best models. |
Similar Papers
Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model (P19-1)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) of news articles has been limited to datasets of a couple of hundred examples. |
| Approach: | They propose a model which integrates a traditional extractive summarization model with a standard SDS model and achieves competitive results on MDS datasets. |
| Outcome: | The proposed model achieves competitive results on large-scale datasets. |
Efficiently Summarizing Text and Graph Encodings of Multi-Document Clusters (2021.naacl-main)
Copied to clipboard
| Challenge: | Abstractive multi-document summarization (MDS) is a task that has seen advances with the introduction of large-scale datasets and powerful Transformer-based models. |
| Approach: | They propose an efficient graph-enhanced approach to multi-document summarization with an encoder-decoder Transformer model. |
| Outcome: | The proposed model scales to large input documents and improves on a multi-document dataset. |
Hierarchical Transformers for Multi-Document Summarization (P19-1)
Copied to clipboard
| Challenge: | Existing models for multidocument summarization have been developed that can process multiple documents in a hierarchical manner. |
| Approach: | They propose a neural summarization model which can process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. |
| Outcome: | The proposed model improves on the WikiSum dataset and can process multiple documents in a hierarchical manner. |
Promoting Topic Coherence and Inter-Document Consorts in Multi-Document Summarization via Simplicial Complex and Sheaf Graph (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that generate summaries from multiple sources often lack accuracy and accuracy due to the length of tokens used in encoding. |
| Approach: | They propose a novel encoder-decoder model that uses pre-trained BART to analyze linguistic nuances, simplicial complex layer to apprehend inherent properties that transcend pairwise associations and sheaf graph attention to effectively capture heterophilic properties. |
| Outcome: | The proposed model achieves consistent performance improvement across all evaluation metrics (syntactical, semantical and faithfulness). |
Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awareness (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to Multi-document summarization are limited due to the extremely long input length. |
| Approach: | They propose an extract-then-abstract Transformer framework to overcome the problem . they leverage pre-trained language models to construct hierarchical extractors and abstractors . |
| Outcome: | The proposed framework outperforms baseline models with comparable model sizes and achieves the best results on the Multi-News, Multi-XScience, and WikiCatSum corpora. |
A Variational Hierarchical Model for Neural Cross-Lingual Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on cross-lingual summarization focus on pipeline methods or jointly training an end-to-end model through an auxiliary MT or MS objective. |
| Approach: | They propose a hierarchical model for the cross-lingual summarization task . the model is based on the conditional variational auto-encoder . |
| Outcome: | The proposed model generates better cross-lingual summaries than comparison models in the few-shot setting. |
Abstractive Multi-Document Summarization via Joint Learning with Single-Document Summarization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for document summarization are extractive and abstractive. |
| Approach: | They propose to jointly learn an abstractive single-document decoder and a decoding controller to aggregate the decoded outputs for multiple input documents. |
| Outcome: | The proposed model outperforms several baselines on two multi-document summarization datasets and proves that it is useful for both tasks. |
PELMS: Pre-training for Effective Low-Shot Multi-Document Summarization (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for abstractive multi-document summarization fail to generate concise, reflective summaries. |
| Approach: | They propose a pre-trained abstractive multi-document summarization model that uses unlabeled multi-doctoral inputs to generate concise, reflective summaries. |
| Outcome: | The proposed model outperforms competing models on a wide range of MDS datasets. |
StructSum: Summarization via Structured Representations (2021.eacl-main)
Copied to clipboard
Vidhisha Balachandran, Artidoro Pagnoni, Jay Yoon Lee, Dheeraj Rajagopal, Jaime Carbonell, Yulia Tsvetkov
| Challenge: | Abstractive summarization models overfit to training corpora, lack of transparency and layout bias . authors propose incorporating latent and explicit dependencies across sentences in source document . |
| Approach: | They propose a framework based on document-level structure induction to address layout bias and lack of transparency in abstractive summarization models. |
| Outcome: | The proposed framework improves coverage of content in the source documents and generates more abstractive summaries by generating more novel n-grams. |
Topic-Guided Abstractive Multi-Document Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on multi-document summarization (MDS) focus on extractive and abstractive approaches to create a fluent and concise summary for a collection of thematically related documents. |
| Approach: | They propose a novel abstractive MDS model that represents multiple documents as a heterogeneous graph and then applies a graph-to-sequence framework to generate summaries. |
| Outcome: | The proposed model outperforms state-of-the-art models on Rouge scores and human evaluation, while learning high-quality topics. |