HardEval: Focusing on Challenging Tokens to Assess Robustness of NER (2020.lrec-1)

Copied to clipboard

Challenge: Named entity recognition (NER) systems are often evaluated on human annotations . a new evaluation method focuses on subsets of tokens that represent specific sources of errors .
Approach: They propose a method that focuses on subsets of tokens that represent specific sources of errors.
Outcome: The proposed evaluation method focuses on subsets of tokens that represent specific sources of errors.

Similar Papers

Robustness and Adversarial Examples in Natural Language Processing (2021.emnlp-tutorials)

Copied to clipboard

Challenge: This tutorial aims to raise awareness of practical concerns about NLP robustness . it aims at addressing the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift .
Approach: This tutorial aims to bring awareness of practical concerns about NLP robustness . it reviews recent studies on analyzing the weakness of NLP systems when facing adversarial inputs .
Outcome: This tutorial aims to bring awareness of practical concerns about NLP robustness . it will examine the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift .
Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness (2024.naacl-long)

Copied to clipboard

Challenge: Existing approaches to measure robustness are problematic, and out-of-domain evaluations are no longer relevant.
Approach: They examine models of different sizes spanning different architectural choices and pretraining objectives.
Outcome: The results show that not all out-of-domain tests provide insight into robustness . merely scaling models does not make them adequately robust .
Measure and Improve Robustness in NLP Models: A Survey (2022.naacl-main)

Copied to clipboard

Challenge: Despite the performance gains, NLP models are still fragile and brittle to out-of-domain data, adversarial attacks, or small perturbation to the input.
Approach: They propose a survey of how to define, measure and improve robustness in NLP by connecting multiple definitions of robustness and identifying failures.
Outcome: The proposed models are robust against unseen or challenging scenarios, but are still fragile and brittle to out-of-domain data and adversarial attacks.
Are LLM-based Evaluators Confusing NLG Quality Criteria? (2024.acl-long)

Copied to clipboard

Challenge: Existing studies show that LLMs confuse evaluation criteria, which reduces their reliability.
Approach: They propose a hierarchical classification system for 11 common aspects with corresponding different evaluation criteria.
Outcome: The proposed system is based on 11 common aspects with different evaluation criteria.
Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Models (2022.findings-naacl)

Copied to clipboard

Challenge: Existing work identifies task-specific shortcuts via human priors or error analyses, which requires extensive expertise and efforts.
Approach: They propose to automatically identify spurious correlations in NLP models at scale by using existing interpretability methods to extract tokens that significantly affect model’s decision process.
Outcome: The proposed method can identify spurious correlations in NLP models at scale and mitigate these leads to more robust models in multiple applications.
Hard and Soft Evaluation of NLP models with BOOtSTrap SAmpling - BooStSa (2022.acl-demo)

Copied to clipboard

Challenge: Developing better methods for a task is a common feature of the computational linguistics literature.
Approach: They propose to use bootstrap to compute significance levels with the BOOtSTrap SAmpling procedure to evaluate models that predict hard labels and soft labels as well.
Outcome: The proposed method can be used to evaluate models that predict hard labels and soft labels on benchmark data sets.
A Novel Metric for Measuring the Robustness of Large Language Models in Non-adversarial Scenarios (2024.findings-emnlp)

Copied to clipboard

Challenge: Using large language models, we evaluated their robustness on multiple datasets.
Approach: They propose a new metric for assessing model robustness by empirical evaluation of several models on multiple datasets.
Outcome: The proposed metric is based on a set of datasets that are constructed by introducing naturally-occurring, non-malicious perturbations or by generating semantically equivalent paraphrases of input questions or statements.
Towards Building More Robust NER datasets: An Empirical Study on NER Dataset Bias from a Dataset Difficulty View (2023.emnlp-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) models rely on superficial entity patterns for predictions, without considering evidence from the context.
Approach: They propose to de-bias NER datasets by altering entity-context distribution . they also validate the feasibility of the proposed de-bianking techniques .
Outcome: The proposed methods can be applied to different models and improve existing models.
TMR: Evaluating NER Recall on Tough Mentions (2021.eacl-srw)

Copied to clipboard

Challenge: a NER evaluation tool is available via a repository.
Approach: They propose to use Tough Mentions Recall to supplement traditional named entity recognition evaluation by examining recall on specific subsets of ”tough” mentions.
Outcome: The proposed metrics enable differentiation between otherwise similar-scoring systems and identify patterns in performance that would go unnoticed from overall precision, recall, and F1.
Unveiling Strengths and Weaknesses of NLP Systems Based on a Rich Evaluation Corpus: The Case of NER in French (2024.lrec-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is an applicative task for which annotation schemes vary . a lack of robustness of some tools towards textual variation limits evaluation .
Approach: They propose a gold corpus for french annotated with a rich tagset that enables comparison with multiple annotation schemes.
Outcome: The proposed framework enables a fair comparison of NER systems across textual genres and annotation schemes.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations