Challenge: Existing methods to evaluate factual consistency in text summarization neglect the intrinsic cause of factual inconsistency or rely on auxiliary tasks.
Approach: They propose a method to evaluate the factual consistency in text summarization via counterfactual estimation, which formulates the causal relationship between source document, generated summary, and the language prior.
Outcome: The proposed metric improves correlation with human judgments and convenience of usage on three public abstractive text summarization datasets.

Similar Papers

Enhancing Factual Consistency in Text Summarization via Counterfactual Debiasing (2025.coling-main)

Copied to clipboard

Challenge: Abstractive text summarization has produced fluent and informative outputs, but factual inconsistency is a challenge.
Approach: They propose a framework that mitigates the causal effects of language bias and irrelevancy bias by counterfactual estimation.
Outcome: The proposed framework outperforms baseline methods on two widely used summarization datasets.
Evaluating the Factual Consistency of Abstractive Text Summarization (2020.emnlp-main)

Copied to clipboard

Challenge: a weakly-supervised approach is needed to verify factual consistency . auxiliary span extraction tasks are useful for verifying factual consistent summaries .
Approach: They propose a weakly-supervised approach for verifying factual consistency . they transfer the model to summaries generated by several neural models .
Outcome: The proposed approach outperforms models trained with strong supervision on source documents and human evaluations.
Multilingual Summarization with Factual Consistency Evaluation (2023.findings-acl)

Copied to clipboard

Challenge: Abstractive summarization models generate factually inconsistent summaries, reducing their utility for real-world applications.
Approach: They propose to use data filtering and controlled generation to detect hallucinations in machine generated summaries.
Outcome: The proposed models detect factual inconsistencies in machine generated summaries, but they focus on English only.
Entity-level Factual Consistency of Abstractive Text Summarization (2021.eacl-main)

Copied to clipboard

Challenge: Existing models exhibit entity hallucination, generating names of entities that are not present in the source document.
Approach: They propose to use entity-level factual consistency to improve model quality . they propose to filter the training data to reduce entity hallucination problem .
Outcome: The proposed model can reduce the entity hallucination problem by filtering the training data.
Evaluating Factuality in Cross-lingual Summarization (2023.findings-acl)

Copied to clipboard

Challenge: Existing evaluation metrics for monolingual summarization require translation to evaluate the factuality of cross-lingual summmarization.
Approach: They propose to analyze cross-lingual factuality by collecting annotations and generated summaries from models at summary level and sentence level.
Outcome: The proposed dataset shows that over 50% of generated summaries contain factual errors with different characteristics from monolingual summarization.
Improving Factual Consistency of Abstractive Summarization via Question Answering (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that about 30% of summaries generated by neural text summarization suffer from fact fabrication.
Approach: They propose an automatic evaluation metric to measure factual consistency and a learning algorithm that maximizes the metric during model training.
Outcome: The proposed method improves factual consistency and overall quality of summarization models.
Questioning the Validity of Summarization Datasets and Improving Their Factual Consistency (2022.emnlp-main)

Copied to clipboard

Challenge: Abstractive summarization systems have a lack of a defined definition for the task . factual consistency is a key factor in summarizing, but there are still deficiencies . a new study shows that summarized summarisation models achieve improved performance .
Approach: They propose a filtered summarization dataset with improved factual consistency to address this problem . they argue that the dataset should become a valid benchmark for developing and evaluating summarizing systems .
Outcome: The proposed model improves on a popular summarization dataset with improved factual consistency.
TRUE: Re-evaluating Factual Consistency Evaluation (2022.naacl-main)

Copied to clipboard

Challenge: Grounded text generation systems often generate factual inconsistencies, hindering their real-world applicability.
Approach: They propose a method to assess factual consistency metrics on standardized texts . they recommend NLI and question generation-and-answering-based methods as starting points .
Outcome: The proposed method is more actionable and interpretable than previous methods.
SummaCoz: A Dataset for Improving the Interpretability of Factual Consistency Detection for Summarization (2024.findings-emnlp)

Copied to clipboard

Challenge: Summarization is an important application of Large Language Models.
Approach: They integrate human-annotated and model-generated natural language explanations to elucidate how a summary deviates and becomes inconsistent with its source article.
Outcome: The proposed model provides rationales for its judgments and improves its accuracy significantly.
FENICE: Factuality Evaluation of summarization based on Natural language Inference and Claim Extraction (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in text summarization have shown remarkable performance, but a significant number of summaries exhibit factual inconsistencies, such as hallucinations.
Approach: They propose a factuality-oriented metric that evaluates text summarization for accuracy . they use a human annotation process to examine the accuracy of automatically generated summaries .
Outcome: The proposed metric sets a new state-of-the-art on AGGREFACT, the de-facto benchmark for factuality evaluation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations