Challenge: Existing datasets that test incrementally update entity summaries are lacking.
Approach: They propose a fully synthetic dataset that exposes real-world IES challenges by generating diverse attributes, summaries, and unstructured paragraphs with 99% alignment accuracy.
Outcome: The proposed dataset shows that state-of-the-art LLMs struggle to update summaries with an F1 higher than 80.4%.

Similar Papers

Entity-level Factual Consistency of Abstractive Text Summarization (2021.eacl-main)

Copied to clipboard

Challenge: Existing models exhibit entity hallucination, generating names of entities that are not present in the source document.
Approach: They propose to use entity-level factual consistency to improve model quality . they propose to filter the training data to reduce entity hallucination problem .
Outcome: The proposed model can reduce the entity hallucination problem by filtering the training data.
EntSUMv2: Dataset, Models and Evaluation for More Abstractive Entity-Centric Summarization (2023.emnlp-main)

Copied to clipboard

Challenge: Entity-centric summarization is a form of controllable summarizing that aims to generate a summary for a specific entity given a document.
Approach: They propose to use a more abstract version of the original entity-centric ENTSUM summarization dataset to generate a shorter annotated summary for downstream users.
Outcome: The proposed method is more abstract and uses supervised fine-tuning and large-scale instruction tuning to provide more specific and useful summaries for downstream users.
Ranking Generated Summaries by Correctness: An Interesting but Challenging Application for Natural Language Inference (P19-1)

Copied to clipboard

Challenge: Recent advances on abstractive summarization have led to fluent summaries, but factual errors in generated summary still severely limit their use in practice.
Approach: They evaluate summaries produced by state-of-the-art models via crowdsourcing and show that factual errors occur frequently.
Outcome: The proposed models can detect errors and reduce them by reranking alternative summaries.
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics (2021.naacl-main)

Copied to clipboard

Challenge: Modern summarization models generate fluent but often factually unreliable outputs.
Approach: They propose to use human annotations to identify different categories of factual errors and benchmark factuality metrics to improve summarization evaluation.
Outcome: The proposed method identifies the proportion of different categories of factual errors and benchmarks their human judgements as well as their specific strengths and weaknesses.
From Moments to Milestones: Incremental Timeline Summarization Leveraging Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Prior work on timeline summarization has neglected the potential synergy between the two forms of timelines.
Approach: They propose a timeline summarization approach that leverages large language models to generate both event and topic timelines.
Outcome: The proposed approach outperforms the best existing approaches in four TLS benchmarks.
WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation (2021.acl-short)

Copied to clipboard

Challenge: Existing summarization datasets are limited in their ability to evaluate output . a human evaluation is necessary to understand and improve summarizing systems .
Approach: They propose a dataset based on how-to articles and coherent paragraph summaries written in plain language.
Outcome: The proposed dataset makes human evaluation easier and more effective . the authors compare the proposed dataset to existing ones on PubMed and the literature.
Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infilling (2022.emnlp-main)

Copied to clipboard

Challenge: Abstractive summarization models often generate inconsistent summaries containing factual errors or fabricated content.
Approach: They propose to generate representative examples of non-factual summaries through infilling language models and train a robust fact-correction model to post-edit them to improve factual consistency.
Outcome: The proposed model outperforms previous methods in correcting factual errors on two popular summarization datasets.
SummEval: Re-evaluating Summarization Evaluation (2021.tacl-1)

Copied to clipboard

Challenge: a lack of comprehensive studies on evaluation metrics for text summarization hinders progress . a new study aims to improve evaluation metrics that correlate with human judgments .
Approach: They propose to re-evaluate automatic evaluation metrics and share a toolkit for evaluation . they hope to promote a more complete evaluation protocol for text summarization .
Outcome: The proposed evaluation metrics are inconsistent with existing evaluation protocols.
EntSUM: A Data Set for Entity-Centric Extractive Summarization (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for controllable summarization fail to generate entity-centric summaries.
Approach: They propose to use a human-annotated data set EntSUM to generate controllable summarization with a focus on named entities as the aspects to control.
Outcome: The proposed data set shows that existing methods fail to generate entity-centric summaries.
Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for extractive summarization lack coherence, despite improvements . a human-annotated dataset is used to improve coherency of extractive summary .
Approach: They propose to use human-annotated datasets to create coherent extractive summaries . they use supervised fine-tuning and natural language user feedback to enhance coherence .
Outcome: The proposed dataset shows that LLMs can produce coherent summaries with human feedback.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations