Challenge: BERTScore, BLEURT, and COMET are automatic evaluation metrics that are often underperformed on adversarially-synthesized texts.
Approach: They examine MT evaluation metric performance on adversarially-synthesized texts . they validate that automatic metrics tend to overpenalize adversarial-degraded translations .
Outcome: The results show that automatic metrics tend to overpenalize adversarially-degraded translations.

Similar Papers

Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for judging metrics are sensitive to the translations used for evaluation, leading to falsely confident conclusions about a metric’s efficacy.
Approach: They propose a method for thresholding performance improvement under an automatic metric against human judgements by using a pairwise system ranking method.
Outcome: The proposed method allows quantification of type I versus type II errors incurred, i.e., insignificant human differences in system quality that are accepted, and significant human differences that are rejected.
MENLI: Robust Evaluation Metrics from Natural Language Inference (2023.tacl-1)

Copied to clipboard

Challenge: Recent proposed BERT-based evaluation metrics for text generation are vulnerable to adversarial attacks, e.g., relating to information correctness.
Approach: They propose to use BERT-based evaluation metrics for text generation to evaluate text for semantic similarity but are vulnerable to adversarial attacks using Natural Language Inference.
Outcome: The proposed metrics outperform existing summarization metrics but perform below SOTA MT metrics on standard benchmarks.
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training (2023.acl-long)

Copied to clipboard

Challenge: Automated metrics are used for machine translation, but they are often considered to be black boxes with potential biases that are difficult to detect.
Approach: They analyze automatic metrics from the perspective of their guidance for machine translation training.
Outcome: The proposed measures improve the performance of machine translation models.
A Novel Metric for Measuring the Robustness of Large Language Models in Non-adversarial Scenarios (2024.findings-emnlp)

Copied to clipboard

Challenge: Using large language models, we evaluated their robustness on multiple datasets.
Approach: They propose a new metric for assessing model robustness by empirical evaluation of several models on multiple datasets.
Outcome: The proposed metric is based on a set of datasets that are constructed by introducing naturally-occurring, non-malicious perturbations or by generating semantically equivalent paraphrases of input questions or statements.
Evaluating Automatic Metrics with Incremental Machine Translation Systems (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have shown that neural metrics are more reliable than non-neural metrics.
Approach: They propose to use commercial machine translations to evaluate machine translation metrics based on their preference for more recent outputs.
Outcome: The proposed dataset confirms several previous findings, including the advantage of neural metrics over non-neural ones, and also explores the debated issue of how MT quality affects metric reliability.
Can Automatic Metrics Assess High-Quality Translations? (2024.emnlp-main)

Copied to clipboard

Challenge: a recent human evaluation study found that translations produced by current MT systems achieve very high-quality scores when judged by humans on a direct assessment scale of 0 to 100.
Approach: They stress-test the ability of current translation quality metrics to detect correct translations . they show that current metrics often over or underestimate translation quality .
Outcome: The proposed method overestimates translation quality, the authors show . they show that current metrics often overestimate translation quality .
DEMETR: Diagnosing Evaluation Metrics for Translation (2022.emnlp-main)

Copied to clipboard

Challenge: BLEU scores are based on string overlap, but they are opaque in comparison to newer learned metrics.
Approach: They propose a dataset to evaluate MT evaluation metrics based on linguistic perturbations in English . they find learned metrics perform substantially better than string-based metrics .
Outcome: The proposed dataset shows that learned metrics perform better than string-based metrics . the dataset contains 31K English examples that cover 35 different linguistic phenomena .
Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages (2026.acl-long)

Copied to clipboard

Challenge: Existing metrics have been developed and validated for English and other languages . this narrow focus leaves Indian languages largely overlooked, casting doubt on universality of current evaluation practices.
Approach: They propose a large-scale benchmark that compares 26 automatic metrics with human judgments across six major Indian languages.
Outcome: ITEM evaluates alignment of 26 automatic metrics with human judgments across six languages . authors: outliers exert significant impact on metric-human agreement, improve fidelity . they say the results offer critical guidance for advancing metric design and evaluation in Indian languages - a global market for machine translation and text summarization systems.
Machine Translation of Restaurant Reviews: New Corpus for Domain Adaptation and Robustness (D19-56)

Copied to clipboard

Challenge: BLEU: MT is a very robust and efficient way to translate user-generated content.
Approach: They propose a task to encourage research on MT robustness and domain adaptation . they ask professionals to translate 11.5k french 4SQ reviews to English .
Outcome: The proposed task improves on the existing MT systems in a real-world scenario . the proposed methods improve translation accuracy and sentiment analysis .
Extrinsic Evaluation of Machine Translation Metrics (2023.acl-long)

Copied to clipboard

Challenge: MT metrics are widely used to distinguish the quality of machine translation systems across relatively large test sets.
Approach: They evaluate the segment-level performance of the most widely used MT metrics by correlating them with how useful they are for downstream tasks.
Outcome: The MT metrics are widely used to distinguish the quality of machine translation systems across relatively large test sets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations