Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Texts (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current research focuses on predefined aspects within structured texts, neglecting complexities of dynamic and disordered environments. |
| Approach: | They propose a benchmark for dynamic aspect-based summarization tailored to unstructured text. |
| Outcome: | The proposed benchmark addresses the complexities of dynamic and disordered environments in unstructured text. |
Similar Papers
MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarization (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating content specific summarization assume a fixed set of known aspects. |
| Approach: | They propose a dynamic aspect-based summarization framework that optimizes aspect number prediction and minimizes disparity between generated and reference summaries. |
| Outcome: | The proposed method outperforms baselines on three diverse datasets on different aspects of the input text. |
Summarizing Text on Any Aspects: A Knowledge-Informed Weakly-Supervised Approach (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on aspect-based abstractive summarization assume a small set of aspects and do not consider other diverse aspects. |
| Approach: | They propose a weak supervision construction method and an aspect modeling scheme to solve this problem. |
| Outcome: | The proposed method significantly expands the application of the task in practice. |
OASum: Large-Scale Open Domain Aspect-based Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing generic summarization methods generate only one summary for all different requests which is not optimal for diverse demands. |
| Approach: | They use crowd-sourced knowledge on Wikipedia to create a large-scale open-domain aspect-based summarization dataset with 1 million different aspects on 2 million Wikipedia pages. |
| Outcome: | The proposed model can generate diverse aspect-based summarizations on Wikipedia with zero/few-shot and fine-tuning on seven downstream datasets. |
OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models focus on a limited set of predefined aspects, resulting in a lack of realistic open aspect setting. |
| Approach: | They propose a benchmark for multi-document open aspect-based summarization using an annotation protocol. |
| Outcome: | The proposed benchmark satisfies the needs of users in real-world scenarios. |
SumPubMed: Summarization Dataset of PubMed Scientific Articles (2021.acl-srw)
Copied to clipboard
| Challenge: | Existing summarization models that can extract the top few lines of news articles fail to summarize long documents. |
| Approach: | They constructed a scientific summarization dataset from MEDLINE articles from the PubMed archive to address this problem. |
| Outcome: | The proposed model outperforms existing models on news article summarization datasets and shows that it is more efficient to extract the top few lines. |
Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects - A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | scholarly attention has turned to the development of text summarization methods that are more closely tailored and controlled to align with specific objectives and user needs. |
| Approach: | They formalize a controllable text summarization task and categorize controllability attributes according to their shared characteristics and objectives. |
| Outcome: | The proposed method is tailored to meet the specific intent and needs of users. |
What Have We Achieved on Text Summarization? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text summarization have been investigated, but there are still gaps between them and human professionals. |
| Approach: | They analyze 8 major sources of errors on 10 representative summarization models manually. |
| Outcome: | Aiming to gain more understanding of summarization systems with respect to their strengths and limitations on a fine-grained syntactic and semantic level, we use 8 major sources of errors on 10 representative summarizing models. |
SUMIE: A Synthetic Benchmark for Incremental Entity Summarization (2025.coling-main)
Copied to clipboard
| Challenge: | Existing datasets that test incrementally update entity summaries are lacking. |
| Approach: | They propose a fully synthetic dataset that exposes real-world IES challenges by generating diverse attributes, summaries, and unstructured paragraphs with 99% alignment accuracy. |
| Outcome: | The proposed dataset shows that state-of-the-art LLMs struggle to update summaries with an F1 higher than 80.4%. |
WikiAsp: A Dataset for Multi-domain Aspect-based Summarization (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing aspects-based summarization models are domain-specific due to large differences in the type of aspects for different domains. |
| Approach: | They propose a large-scale dataset for multi-domain aspect-based summarization using Wikipedia articles from 20 different domains. |
| Outcome: | The proposed model is based on Wikipedia articles from 20 different domains and uses the section titles and boundaries of each article as a proxy for aspect annotation. |
MDS: A Fine-Grained Dataset for Multi-Modal Dialogue Summarization (2024.lrec-main)
Copied to clipboard
| Challenge: | Summarizing the dialogue into a short message has drawn much attention due to the explosion of various dialogue scenes. |
| Approach: | They develop a multi-modal dialogue summarization dataset to enhance the variety of data available for this research area. |
| Outcome: | The proposed dataset provides a demanding testbed for multi-modal dialogue summarization. |