Challenge: Current factuality metrics do not account for vision modality, thus are not adequate for vision-and-language summarization.
Approach: They propose a weighted combination of CLIPScore and BERTScore to evaluate factuality for abstractive document summarization.
Outcome: The proposed metric outperforms existing factuality metrics on four factuity metric-evaluation benchmarks and is robust to human judgments.

Similar Papers

How Far are We from Robust Long Abstractive Summarization? (2022.emnlp-main)

Copied to clipboard

Challenge: Abstractive summarization has made tremendous progress in recent years . however, even under a short document setting, abstractive models often generate summaries that are repetitive, ungrammatical, and factually inconsistent with the source.
Approach: They perform fine-grained human annotations to evaluate long document abstractive summarization systems and develop factual consistency metrics.
Outcome: The proposed model can generate more relevant summaries but not factual ones.
LongDocFACTScore: Evaluating the Factuality of Long Document Abstractive Summarisation (2024.lrec-main)

Copied to clipboard

Challenge: Existing metrics for text summarisation have restrictive token limits, limiting their effectiveness.
Approach: They propose a human-annotated data set for evaluating automatic factuality metrics . they propose 'longDocFACTScore' framework which can be extended to any length document .
Outcome: The proposed framework outperforms state-of-the-art metrics in evaluating long document summarisation data sets.
Improving Factuality of Abstractive Summarization without Sacrificing Summary Quality (2023.acl-short)

Copied to clipboard

Challenge: Recent studies have shown that most abstractive summarization models are unfaithful and suffer from a wide range of hallucination.
Approach: They propose a candidate summary generation and ranking technique to improve summary factuality without sacrificing quality.
Outcome: The proposed method shows that the model trained using the proposed method improves on factuality and similarity-based metrics without conflicting with the model.
Fact-based Content Weighting for Evaluating Abstractive Summarisation (2020.acl-main)

Copied to clipboard

Challenge: Abstractive summarisation is notoriously hard to evaluate since word-overlap-based metrics are insufficient.
Approach: They propose a new evaluation metric which is based on fact-level content weighting, relating the facts of the document to the facts in the summary.
Outcome: The proposed evaluation metric is highly correlated to human perception and compares favourably to the recent manual highlight-based metric of Hardy et al.
X-FACTOR: A Cross-metric Evaluation of Factual Correctness in Abstractive Summarization (2022.emnlp-main)

Copied to clipboard

Challenge: Abstractive summarization models produce factually inconsistent summaries that are not supported by the original article.
Approach: They propose a fact-aware filtering mechanism that improves the factuality of abstractive summarization models.
Outcome: The proposed method improves the quality of training data and the factuality of generated summaries.
Evaluating the Tradeoff Between Abstractiveness and Factuality in Abstractive Summarization (2023.findings-eacl)

Copied to clipboard

Challenge: Abstractive summarization models generate fluent and well-formed output but lack semantic faithfulness, or factuality, with respect to the input documents.
Approach: They propose new factuality metrics that adjust for the degree of abstractiveness . they propose to visualize the rates of change in factual as we gradually increase abstractiveity .
Outcome: The proposed models generate fluent and well-formed summaries but lack semantic faithfulness, or factuality, with respect to the input documents.
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics (2021.naacl-main)

Copied to clipboard

Challenge: Modern summarization models generate fluent but often factually unreliable outputs.
Approach: They propose to use human annotations to identify different categories of factual errors and benchmark factuality metrics to improve summarization evaluation.
Outcome: The proposed method identifies the proportion of different categories of factual errors and benchmarks their human judgements as well as their specific strengths and weaknesses.
On Faithfulness and Factuality in Abstractive Summarization (2020.acl-main)

Copied to clipboard

Challenge: Existing conditional text generation models produce unfaithful and unfaithed summaries . current models accomplish a high level of fluency and coherence .
Approach: They propose to use pretrained models for document summarization to better understand hallucinations . they find that textual entailment measures better correlate with faithfulness .
Outcome: The proposed models generate faithful and factual summaries as evaluated by humans.
NonFactS: NonFactual Summary Generation for Factuality Evaluation in Document Summarization (2023.findings-acl)

Copied to clipboard

Challenge: Pre-trained abstractive summarization models generate fluent summaries that are inconsistent with context document and contain nonfactual information.
Approach: They propose a data generation model that synthesizes nonfactual summaries using human annotations.
Outcome: The proposed model can generate nonfactual summaries and generalize to out-of-domain documents.
Evaluating the Factual Consistency of Abstractive Text Summarization (2020.emnlp-main)

Copied to clipboard

Challenge: a weakly-supervised approach is needed to verify factual consistency . auxiliary span extraction tasks are useful for verifying factual consistent summaries .
Approach: They propose a weakly-supervised approach for verifying factual consistency . they transfer the model to summaries generated by several neural models .
Outcome: The proposed approach outperforms models trained with strong supervision on source documents and human evaluations.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations