Challenge: Recent studies show that abstractive summarization approaches generate summaries that are not factually consistent with the source document.
Approach: They propose a method that decomposes the document and summary into structured meaning representations (MRs) MRs describe core semantic concepts and their relations, aggregating the main content in both document and summary in a canonical form .
Outcome: The proposed method outperforms existing methods on benchmarks for factuality evaluation.

Similar Papers

Enhancing Factual Consistency of Abstractive Summarization (2021.naacl-main)

Copied to clipboard

Challenge: Abstractive summarization models often distort or fabricate facts in articles . factual inconsistency is a common problem with abstractive summaries .
Approach: They propose a fact-aware summarization model FASum to extract factual relations into the summary generation process via graph attention.
Outcome: The proposed model can produce abstractive summaries with higher factual consistency compared with existing systems and corrects factual errors via modifying only a few keywords.
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics (2021.naacl-main)

Copied to clipboard

Challenge: Modern summarization models generate fluent but often factually unreliable outputs.
Approach: They propose to use human annotations to identify different categories of factual errors and benchmark factuality metrics to improve summarization evaluation.
Outcome: The proposed method identifies the proportion of different categories of factual errors and benchmarks their human judgements as well as their specific strengths and weaknesses.
Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (2023.acl-long)

Copied to clipboard

Challenge: Abstractive summarization systems still include factual errors in generated summaries despite recent improvements in factuality detection .
Approach: They aggregate factuality error annotations from nine existing datasets and stratify them according to the underlying summarization model.
Outcome: The proposed method improves on the ChatGPT-based model and shows that it is not superior for all error types.
Factual Relation Discrimination for Factuality-oriented Abstractive Summarization (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing factuality-oriented abstractive summarization models only consider the integration of factual information and ignore the causes of factuual errors.
Approach: They propose a factuality-oriented abstractive summarization model that can identify the causes of factual errors.
Outcome: The proposed model outperforms state-of-the-art models in factual metrics.
Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to evaluate factual consistency in text summarization neglect the intrinsic cause of factual inconsistency or rely on auxiliary tasks.
Approach: They propose a method to evaluate the factual consistency in text summarization via counterfactual estimation, which formulates the causal relationship between source document, generated summary, and the language prior.
Outcome: The proposed metric improves correlation with human judgments and convenience of usage on three public abstractive text summarization datasets.
Annotating and Modeling Fine-grained Factuality in Summarization (2021.naacl-main)

Copied to clipboard

Challenge: Recent abstractive summarization systems produce factual errors that are not faithful to the input . current methods are lacking in identifying what errors are most important to target .
Approach: They use synthetic and human-labeled data to identify factual errors in summarization and train models on the factuality detection task.
Outcome: The proposed model detects factual errors on word, dependency, and sentence levels.
NonFactS: NonFactual Summary Generation for Factuality Evaluation in Document Summarization (2023.findings-acl)

Copied to clipboard

Challenge: Pre-trained abstractive summarization models generate fluent summaries that are inconsistent with context document and contain nonfactual information.
Approach: They propose a data generation model that synthesizes nonfactual summaries using human annotations.
Outcome: The proposed model can generate nonfactual summaries and generalize to out-of-domain documents.
FENICE: Factuality Evaluation of summarization based on Natural language Inference and Claim Extraction (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in text summarization have shown remarkable performance, but a significant number of summaries exhibit factual inconsistencies, such as hallucinations.
Approach: They propose a factuality-oriented metric that evaluates text summarization for accuracy . they use a human annotation process to examine the accuracy of automatically generated summaries .
Outcome: The proposed metric sets a new state-of-the-art on AGGREFACT, the de-facto benchmark for factuality evaluation.
FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge (2023.emnlp-main)

Copied to clipboard

Challenge: Existing factuality evaluation models are not robust, especially with respect to entity and relation errors in new domains.
Approach: They propose a new approach to factuality evaluation that is generalizable across domains . they propose entities-specific facts, facts extracted from external knowledge bases and facts constructed compositionally through knowledge base walks.
Outcome: The proposed model achieves state-of-the-art on two in-domain news summarization benchmarks and on three out-of domain scientific literature datasets.
Evaluating Factuality in Cross-lingual Summarization (2023.findings-acl)

Copied to clipboard

Challenge: Existing evaluation metrics for monolingual summarization require translation to evaluate the factuality of cross-lingual summmarization.
Approach: They propose to analyze cross-lingual factuality by collecting annotations and generated summaries from models at summary level and sentence level.
Outcome: The proposed dataset shows that over 50% of generated summaries contain factual errors with different characteristics from monolingual summarization.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations