Soft Layer-Specific Multi-Task Summarization with Entailment and Question Generation (P18-1)
Copied to clipboard
| Challenge: | Recent advances on abstractive summarization have allowed substantial improvements in the quality of the model, but there is still scope for improvement. |
| Approach: | They propose novel multi-task architectures with high-level layer-specific sharing across multiple encoder and decoder layers of the three tasks and soft-sharing mechanisms. |
| Outcome: | The proposed model improves on the CNN/DailyMail and Gigaword datasets and on the DUC-2002 transfer setup. |
Similar Papers
Multi-Reward Reinforced Summarization with Saliency and Entailment (N18-2)
Copied to clipboard
| Challenge: | Abstractive text summarization is the task of compressing and rewriting a long document into a short summary while maintaining saliency, directed logical entailment, and non-redundancy. |
| Approach: | They propose a novel reward function for ROUGESal and Entail to improve abstractive summarization . they use a coverage-based reward function to combine ROUGE and En Tail . |
| Outcome: | The proposed method achieves state-of-the-art results on CNN/Daily Mail dataset and strong improvements in a test-only transfer setup on DUC-2002. |
Ensure the Correctness of the Summary: Incorporate Entailment Knowledge into Abstractive Sentence Summarization (C18-1)
Copied to clipboard
| Challenge: | Existing approaches focus on improving the informativeness of the summary, but ignore the correctness. |
| Approach: | They propose an entailment-aware encoder and an aML-based decoder to improve the correctness of the sentence summarization task. |
| Outcome: | The proposed model outperforms baselines on informativeness and correctness. |
Multi-doc Hybrid Summarization via Salient Representation Learning (2023.acl-industry)
Copied to clipboard
| Challenge: | Multi-document summarization is gaining more and more attention . extractive multi-doc approaches intend to directly extract key facts from multiple sources . |
| Approach: | They propose a multi-document hybrid summarization approach that generates a human-readable summary and extracts corresponding key evidences based on multi-doc inputs. |
| Outcome: | The proposed method generates a human-readable summary and extracts key evidences based on multi-doc inputs. |
Multi-Task Learning for Cross-Lingual Abstractive Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies use pseudo cross-lingual abstractive summarization data to train neural encoder-decoders. |
| Approach: | They propose a multi-task learning framework for cross-lingual abstractive summarization that attaches a special token to the beginning of the input sentence to indicate the target task. |
| Outcome: | The proposed model achieves better performance than the model trained with only pseudo cross-lingual abstractive summarization data. |
Interactive Query-Assisted Summarization via Deep Reinforcement Learning (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing systems that can perform interactive summarization cannot ingest the full document set or operate at sufficient speed for interactivity. |
| Approach: | They propose two deep reinforcement learning models for interactive summarization task . they use interactive session state and history to refrain from redundancy . |
| Outcome: | The proposed model improves informativeness while preserving positive user experience. |
Abstractive Multi-Document Summarization via Joint Learning with Single-Document Summarization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for document summarization are extractive and abstractive. |
| Approach: | They propose to jointly learn an abstractive single-document decoder and a decoding controller to aggregate the decoded outputs for multiple input documents. |
| Outcome: | The proposed model outperforms several baselines on two multi-document summarization datasets and proves that it is useful for both tasks. |
Keeping Consistency of Sentence Generation and Document Classification with Multi-Task Learning (D19-1)
Copied to clipboard
| Challenge: | Existing automated generation of articles' characteristics is inconsistent if they are generated individually. |
| Approach: | They propose a multi-task learning model with a shared encoder and multiple decoders for each task. |
| Outcome: | The proposed model generates more consistent headlines, key phrases and categories . it outperforms baseline model on the ROUGE scores and generates fluent headlines . |
Reinforcement Learning for Abstractive Question Summarization with Question-aware Semantic Rewards (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for summarizing long questions are difficult due to the lack of training data and the complexity of the related subtasks. |
| Approach: | They propose a reinforcement learning-based framework for abstractive question summarization that rewards question-type identification and question-focus recognition for regularizing the question generation model. |
| Outcome: | The proposed method achieves higher performance over state-of-the-art models on two benchmark datasets. |
Topic-Guided Abstractive Multi-Document Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on multi-document summarization (MDS) focus on extractive and abstractive approaches to create a fluent and concise summary for a collection of thematically related documents. |
| Approach: | They propose a novel abstractive MDS model that represents multiple documents as a heterogeneous graph and then applies a graph-to-sequence framework to generate summaries. |
| Outcome: | The proposed model outperforms state-of-the-art models on Rouge scores and human evaluation, while learning high-quality topics. |
Exploring Multitask Learning for Low-Resource Abstractive Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work shows that training text encoders using data from multiple tasks helps to produce an encoder that can be used in numerous downstream tasks with minimal fine-tuning. |
| Approach: | They incorporate four different tasks to improve abstractive summarization performance . they use a pretrained BERT model and train all tasks using a small-scale training corpus . |
| Outcome: | The proposed model outperforms a model trained in a multitask setting with no additional summarization data. |