Long Text and Multi-Table Summarization: Dataset and Method (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing document summarization methods focus on the text and filter out the non-textual content. Existing methods cannot meet the requirements of summarizing long text and multiple tables in each report. |
| Approach: | They propose a dataset for automatic document summarization that uses text and tabular data to produce a concise summary covering the input document's salient information. |
| Outcome: | The proposed method can produce a concise summary covering the input document's salient information. |
Similar Papers
BOOKSUM: A Collection of Datasets for Long-form Narrative Summarization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing text summarization datasets include short-form source documents that lack long-range causal and temporal dependencies and contain strong layout and stylistic biases. |
| Approach: | They propose a dataset for long-form narrative summarization that uses human written summaries on three levels of difficulty. |
| Outcome: | The proposed dataset covers documents from the literature domain, such as novels, plays and stories, and includes highly abstractive, human written summaries on three levels of difficulty. |
The State and Fate of Summarization Datasets: A Survey (2025.naacl-long)
Copied to clipboard
| Challenge: | Summarization is the task of shortening a text while preserving the most important information it contains. |
| Approach: | They propose a novel ontology covering sample properties, collection methods and distribution covering sample characteristics, collection method and distribution. |
| Outcome: | The proposed ontology covers sample properties, collection methods and distribution, and can be used to streamline future research into a more coherent body of work. |
Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documents (2021.acl-short)
Copied to clipboard
| Challenge: | Faceted summarization provides briefings of a document from different perspectives. |
| Approach: | They propose a faceted summarization benchmark built on Emerald journal articles . they propose faceted models that bring structure into faceted documents . |
| Outcome: | The proposed benchmark is based on Emerald journal articles and covers a diverse range of domains. |
BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization (P19-1)
Copied to clipboard
| Challenge: | Existing text summarization datasets are compiled from news articles, where summary-worthy content often appears in the beginning of input articles. |
| Approach: | They present a novel dataset, BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. |
| Outcome: | The proposed dataset is compared with existing summarization datasets and demonstrates that salient content is evenly distributed in the input. |
SQuALITY: Building a Long-Document Summarization Dataset the Hard Way (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing summarization datasets often have issues that seriously limit their usability. |
| Approach: | They propose a faster but more straightforward approach to developing summarization benchmark data . they use a protocol that hires highly-qualified contractors to read stories and write original summaries from scratch . |
| Outcome: | The proposed protocol is faster but more straightforward than scraping summaries from everyday text. |
Beyond Generic Summarization: A Multi-faceted Hierarchical Summarization Corpus of Large Heterogeneous Data (L18-1)
Copied to clipboard
| Challenge: | Automated summarization has focused on ten to twenty documents, typically news articles, but could in theory analyze hundreds of documents from a wide range of sources and provide an overview to the interested reader. |
| Approach: | They propose a method for creating hierarchical summarization corpora from large, heterogeneous document collections by crowdsourcing relevant content and asking trained annotators to order the relevant information hierarchically. |
| Outcome: | The proposed method can be used to develop and evaluate hierarchical summarization systems. |
Chart-to-Text: A Large-Scale Benchmark for Chart Summarization (2022.acl-long)
Copied to clipboard
Shankar Kantharaj, Rixie Tiffany Leong, Xiang Lin, Ahmed Masry, Megh Thakkar, Enamul Hoque, Shafiq Joty
| Challenge: | Inferring key insights from charts can be challenging and time-consuming. |
| Approach: | They propose a task where the goal is to explain a chart and summarize key takeaways from it in natural language. |
| Outcome: | The proposed model produces fluent summaries but suffers from hallucinations and factual errors . the proposed model is compared with other models and can be used to generate BLEU scores . |
Systematically Exploring Redundancy Reduction in Summarizing Long Documents (2020.aacl-main)
Copied to clipboard
| Challenge: | Summarization tasks are often based on importance and diversity, but there is a trade-off between importance and non-redundancy. |
| Approach: | They propose to organize existing methods into categories based on when and how redundancy is considered and propose three additional methods balancing non-redundancy and importance in a general and flexible way. |
| Outcome: | The proposed methods achieve state-of-the-art on two scientific paper datasets, Pubmed and arXiv, while reducing redundancy significantly. |
SumSurvey: An Abstractive Dataset of Scientific Survey Papers for Long Document Summarization (2024.findings-acl)
Copied to clipboard
| Challenge: | a growing need for long document summarization datasets with 16k input is causing problems. |
| Approach: | They propose to use a dataset to analyze salient information in long document summarizations. |
| Outcome: | The proposed dataset outperforms existing models and LLMs in the distribution form of salient information and the distribution of salinal information is an indicator of quality. |
SummN: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents (2022.acl-long)
Copied to clipboard
Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang
| Challenge: | Existing methods to handle long text are limited due to time and memory complexity and limited input lengths. |
| Approach: | They propose a multi-stage split-then-summarize framework for long input summarization . their framework can process input text of arbitrary length by adjusting the number of stages . |
| Outcome: | The proposed framework outperforms existing methods on three long meeting summarization datasets and on a long document summarizing dataset. |