Challenge: Unreliable evaluation guidelines can yield inaccurate assessment outcomes, potentially impeding the advancement of NLG in the right direction.
Approach: They propose to collect annotated human evaluation guidelines and a method for detecting guideline vulnerabilities using Large Language Models.
Outcome: The proposed dataset includes eight vulnerabilities and a method for detecting guideline vulnerabilities.

Similar Papers

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges (2024.emnlp-main)

Copied to clipboard

Challenge: introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.
Approach: They propose a taxonomy for organizing existing LLM-based evaluation metrics and a structured framework to understand and compare them.
Outcome: The proposed taxonomy offers a framework to understand and compare LLM-based evaluation methods.
ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: In this position paper, we argue that human evaluation of generative large language models (LLMs) should be a multidisciplinary undertaking that draws upon the insights from disciplines such as user experience research and human behavioral psychology to ensure that the results are reliable.
Approach: They propose a framework for human evaluation of generative large language models that takes into account usability, aesthetics and cognitive biases.
Outcome: The proposed framework is based on the framework proposed by Deutsch and alnajjar . it is aimed at ensuring that human evaluation is accurate in the age of generative AI .
Robustness Gym: Unifying the NLP Evaluation Landscape (2021.naacl-demos)

Copied to clipboard

Challenge: Existing tools cater to specialized set of evaluations and provide no clear way to leverage or share findings from prior evaluations.
Approach: They propose a toolkit that unifies 4 evaluation paradigms to provide a common platform for evaluation.
Outcome: The proposed evaluation toolkit unifies 4 evaluation paradigms and is under active development.
Perturbation CheckLists for Evaluating NLG Evaluation Metrics (2021.emnlp-main)

Copied to clipboard

Challenge: Existing evaluation metrics for natural language generation are inadequate . existing metrics are not robust against simple perturbations and disagree with scores assigned by humans to perturbed output.
Approach: They propose to propose checks which perturb the output and target a specific criteria and then use them to refine their evaluation.
Outcome: The proposed templates show that existing evaluation metrics are not robust against simple perturbations and disagree with human scores on the perturbed output.
Illusions of the Gold Standard: A Large-scale Analysis of Human Evaluation Protocols for Long-form Text Generation (2026.acl-long)

Copied to clipboard

Challenge: a large-scale analysis of human evaluation protocols for long-form generation tasks is lacking in current practice . current protocols lack proper standardization and operationalization, which can limit validity of evaluation .
Approach: They conduct a large-scale analysis of human evaluation protocols for long-form generation tasks in *CL conference papers from 2023–2025.
Outcome: The proposed evaluation protocols lack standardization and operationalization, the authors show . they also find that the evaluation protocols are inadequate for specific domains and tasks .
Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications (2022.naacl-main)

Copied to clipboard

Challenge: Evaluating natural language generation systems is difficult, as there are many ways to express similar things in text.
Approach: They combine interviews with NLG practitioners to examine ethical considerations and their implications for NLG evaluation.
Outcome: The findings of the study surface goals, community practices, assumptions, and constraints that shape NLG evaluations, and examine their implications and how they embody ethical considerations.
Are LLM-based Evaluators Confusing NLG Quality Criteria? (2024.acl-long)

Copied to clipboard

Challenge: Existing studies show that LLMs confuse evaluation criteria, which reduces their reliability.
Approach: They propose a hierarchical classification system for 11 common aspects with corresponding different evaluation criteria.
Outcome: The proposed system is based on 11 common aspects with different evaluation criteria.
A Tutorial on Evaluation Metrics used in Natural Language Generation (2021.naacl-tutorials)

Copied to clipboard

Challenge: This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field.
Approach: This tutorial presents the evolution of automatic evaluation metrics to their current state . it aims to assess the extent of scientific progress made and identify areas/components that need improvement .
Outcome: This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field.
SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models (2025.naacl-industry)

Copied to clipboard

Challenge: Typical evaluations of Large Language Models (LLMs) report a single accuracy metric per dataset, often derived from an optimized setup.
Approach: They propose a framework for non-adversarial evaluation of large language models that evaluates models by repeatedly testing them on the same benchmarks in various setups.
Outcome: The proposed framework evaluates models by repeatedly testing them on the same benchmarks in various setups to give a realistic estimate of their accuracy and consistency.
Navigating the Modern Evaluation Landscape: Considerations in Benchmarks and Frameworks for Large Language Models (LLMs) (2024.lrec-tutorials)

Copied to clipboard

Challenge: General-purpose Language Models have changed the world of Natural Language Processing, if not the world itself.
Approach: This tutorial will lay the foundations and explain the basics of evaluation and compare traditional methods to newly developed methods.
Outcome: The tutorial assumes little familiarity with metrics, datasets, prompts and benchmarks . it will compare traditional methods to newly developed methods .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations