Challenge: Existing evaluation metrics focus on content selection, not linguistic quality . proposed GRUEN measures Grammaticality, non-redundancy, focUs, structure and coherence of generated text.
Approach: They propose to use a BERT-based model and a class of syntactic, semantic, and contextual features to examine the system output.
Outcome: Experiments show that the proposed metric correlates highly with human judgments.

Similar Papers

A Tutorial on Evaluation Metrics used in Natural Language Generation (2021.naacl-tutorials)

Copied to clipboard

Challenge: This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field.
Approach: This tutorial presents the evolution of automatic evaluation metrics to their current state . it aims to assess the extent of scientific progress made and identify areas/components that need improvement .
Outcome: This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field.
Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale (2020.coling-main)

Copied to clipboard

Challenge: a few popular metrics are still used to evaluate language generation systems despite their known limitations.
Approach: They propose to use automatic metrics to evaluate language generation systems . they show that they prefer system outputs to human-authored texts .
Outcome: The proposed metrics are insensitive to correct translations of rare words and can yield high scores when given a single sentence as system output for the entire test set.
On the Limitations of Reference-Free Evaluations of Generated Text (2022.emnlp-main)

Copied to clipboard

Challenge: a recent study has shown that evaluation metrics which accurately estimate the quality of generated text are limited in their ability to evaluate generated text.
Approach: They argue that reference-free metrics are limited in their ability to evaluate generated text . they recommend that they be used as diagnostic tools for analyzing and understanding model behavior .
Outcome: The proposed evaluation metrics are limited in their ability to evaluate generated text . they can be optimized at test time, can be biased against models with similar outputs .
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for text generation evaluation metrics are lacking in robustness analysis.
Approach: They propose to use stress tests to test for errors in text generation evaluation metrics . they find that BERTScore is confused by truncation errors in summarization .
Outcome: The proposed stress tests show that they are insensitive to errors in open-ended generation, translation, and summarization.
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges (2024.emnlp-main)

Copied to clipboard

Challenge: introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.
Approach: They propose a taxonomy for organizing existing LLM-based evaluation metrics and a structured framework to understand and compare them.
Outcome: The proposed taxonomy offers a framework to understand and compare LLM-based evaluation methods.
A Human Evaluation of AMR-to-English Generation Systems (2020.coling-main)

Copied to clipboard

Challenge: a recent human evaluation of AMR generation systems is compared to automated metrics.
Approach: They propose a human evaluation which collects fluency and adequacy scores and categorization of error types for AMR generation systems.
Outcome: The results show that human evaluations are more nuanced than automated metrics.
BLEURT: Learning Robust Metrics for Text Generation (2020.acl-main)

Copied to clipboard

Challenge: Text generation has made significant advances, but evaluation metrics have lagged behind.
Approach: They propose a learning evaluation metric for English based on BERT . BLEURT can model human judgment with a few thousand possibly biased training examples .
Outcome: The proposed model can model human judgment with a few thousand potentially biased training examples.
HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation (2023.acl-long)

Copied to clipboard

Challenge: Similes are a crucial part of creative writing, but there is still a lack of evaluation metrics for simile generation.
Approach: They propose to use similes as a tool to evaluate simile generation metrics . they propose to combine five criteria and automatic metrics for each criterion .
Outcome: The proposed metrics are significantly more correlated with human ratings from each perspective compared with prior automatic metrics.
RoMe: A Robust Metric for Evaluating Natural Language Generation (2022.acl-long)

Copied to clipboard

Challenge: Empirical results suggest that RoMe has a stronger correlation to human judgment over state-of-the-art metrics in evaluating system-generated sentences across several NLG tasks.
Approach: They propose an automatic evaluation metric incorporating several core aspects of natural language understanding (language competence, syntactic and semantic variation).
Outcome: The proposed evaluation metric is trained on language features such as semantic similarity combined with tree edit distance and grammatical acceptability, using a self-supervised neural network.
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing learning metrics are limited to tasks where large human ratings are available.
Approach: They propose a model-based natural language generation (NLG) evaluation metric that is highly correlated with human judgements without requiring human annotation.
Outcome: The proposed metric outperforms all prior unsupervised metrics on multiple NLG tasks including translation, image captioning, and WebNLG text generation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations