Challenge: Recent work on summarization and headline generation focuses on maximizing ROUGE scores.
Approach: They propose an extrinsic evaluation metric that maximizes ROUGE scores for automatic summarization and headline generation.
Outcome: The proposed model maximizes ROUGE scores while increasing competitive results.

Similar Papers

Using Question Answering Rewards to Improve Abstractive Summarization (2021.findings-emnlp)

Copied to clipboard

Challenge: Neural abstractive summarization models have seen improvements in recent years, but they still suffer from multiple drawbacks.
Approach: They propose a general framework to train abstractive summarization models to alleviate these issues by question-answering based rewards.
Outcome: The proposed framework is preferred over general abstractive summarization models.
SummEval: Re-evaluating Summarization Evaluation (2021.tacl-1)

Copied to clipboard

Challenge: a lack of comprehensive studies on evaluation metrics for text summarization hinders progress . a new study aims to improve evaluation metrics that correlate with human judgments .
Approach: They propose to re-evaluate automatic evaluation metrics and share a toolkit for evaluation . they hope to promote a more complete evaluation protocol for text summarization .
Outcome: The proposed evaluation metrics are inconsistent with existing evaluation protocols.
Improving Factual Consistency of Abstractive Summarization via Question Answering (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that about 30% of summaries generated by neural text summarization suffer from fact fabrication.
Approach: They propose an automatic evaluation metric to measure factual consistency and a learning algorithm that maximizes the metric during model training.
Outcome: The proposed method improves factual consistency and overall quality of summarization models.
A Critical Look at Meta-evaluating Summarisation Evaluation Metrics (2024.findings-emnlp)

Copied to clipboard

Challenge: Effective summarisation evaluation metrics enable researchers and practitioners to compare different summarization systems efficiently.
Approach: They argue that evaluation metrics are primarily meta-evaluated on news summarisation datasets and that there has been a noticeable shift in research focus towards evaluating the faithfulness of generated summaries.
Outcome: The evaluation metrics are primarily meta-evaluated on news summarisation datasets and there has been a noticeable shift in research focus towards evaluating the faithfulness of generated summaries.
Answers Unite! Unsupervised Metrics for Reinforced Summarization Models (D19-1)

Copied to clipboard

Challenge: Abstractive summarization approaches based on Reinforcement Learning (RL) have been proposed to overcome classical likelihood maximization.
Approach: They propose to use Reinforcement Learning to learn the model parameters through RL techniques to overcome classical likelihood maximization.
Outcome: The proposed measures favor ROUGE with the additional property of not requiring reference summaries.
Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary (2021.tacl-1)

Copied to clipboard

Challenge: Existing text overlap based evaluation metrics are limited to matching tokens, either lexically or via embeddings.
Approach: They propose a metric to evaluate the content quality of a summary using question-answering (QA) QA-based methods directly measure a summary’s information overlap with a reference, making them fundamentally different from text overlap metrics.
Outcome: The proposed metric outperforms current state-of-the-art metrics on most evaluations using benchmark datasets while being competitive on others due to limitations of state- of-the art models.
Guiding Extractive Summarization with Question-Answering Rewards (N19-1)

Copied to clipboard

Challenge: a primary challenge faced by extractive summarization systems is the lack of annotated data.
Approach: They propose a supervised extractive summarization system that rewards question-answering by identifying salient sequences of words from a document and highlighting them in the text.
Outcome: The proposed system compares with baselines of strong summarization and human assessors on question-answering.
Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE? (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods to evaluate text summarization tasks using ROUGE have been criticized for lack of semantic understanding.
Approach: They propose a semantic-aware metric for extractive summarization task that is semantic-based . they use CNN/DailyMail dataset to study the new metric .
Outcome: The proposed metric is semantic-aware and shows higher correlation with human judgement and yields a large number of disagreements with the original ROUGE metric.
Is Summary Useful or Not? An Extrinsic Human Evaluation of Text Summaries on Downstream Tasks (2024.lrec-main)

Copied to clipboard

Challenge: a recent study focused on intrinsic evaluation, which assesses the quality of summaries, e.g. coherence, fluency, and informativeness, but it focused on task-based extrinsic evaluation to determine the usefulness of summarizations.
Approach: They incorporate three downstream tasks to measure the usefulness of summaries . they find that fine-tuned models produce more useful summary across all three tasks .
Outcome: The proposed model produces more useful summaries across all three tasks compared to zero-shot models . human evaluation provides more reliable performance assessment compared with automatic methods .
Re-evaluating Evaluation in Text Summarization (2020.emnlp-main)

Copied to clipboard

Challenge: Automated evaluation metrics are an essential part of the development of text-generation tasks such as summarization.
Approach: They propose to use top-scoring system outputs to assess the reliability of automatic evaluation metrics for text summarization.
Outcome: The proposed evaluation method is based on human judgments from 25 top-scoring neural summarization systems.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations