Challenge: a promising research direction consists of designing neural models capable of generating natural language explanations for their predictions.
Approach: They propose a framework for sanity checking models against inconsistent explanations . they apply the framework to a state-of-the-art neural natural language inference model .
Outcome: The proposed framework can generate inconsistent explanations on a state-of-the-art model . it also addresses the problem of adversarial attacks with full target sequences .

Similar Papers

KNOW How to Make Up Your Mind! Adversarially Detecting and Alleviating Inconsistencies in Natural Language Explanations (2023.acl-short)

Copied to clipboard

Challenge: eIA is an adversarial attack that generates inconsistent natural language explanations (NLEs) a model that generate In-NLE is undesirable, as it has a faulty decision-making process or is prone to inconsistencies.
Approach: They propose an off-the-shelf mitigation method to alleviate inconsistencies by grounding the model into external background knowledge.
Outcome: The proposed method reduces inconsistencies detected by previous models . it is based on external knowledge bases and a novel approach to mitigate inconsistent models based upon the proposed method .
Towards Consistent Natural-Language Explanations via Explanation-Consistency Finetuning (2025.coling-main)

Copied to clipboard

Challenge: Large language models generate convincing, fluent explanations, but they often generate inconsistent explanations on different inputs.
Approach: They propose a method that adapts large language models to generate more consistent explanations on related examples.
Outcome: The proposed method yields a 10.0% relative explanation consistency improvement across a variety of question-answering datasets and generalizes to 7 out-of-distribution datasets not seen during finetuning (+4.5%)
Generating Natural Language Adversarial Examples (D18-1)

Copied to clipboard

Challenge: Recent research has shown that deep neural networks are vulnerable to adversarial examples, perturbations to correctly classified examples which can cause the model to misclassify.
Approach: They propose to generate adversarial examples that fool well-trained sentiment analysis and textual entailment models by using a black-box population-based optimization algorithm.
Outcome: The proposed model is able to fool well-trained sentiment analysis and textual entailment models with success rates of 97% and 70%, respectively.
A Logic-Driven Framework for Consistency of Neural Models (D19-1)

Copied to clipboard

Challenge: Recent advances in NLP have improved performance on benchmarks such as GLUE . however, tracking performance on a leaderboard is not sufficient to characterize model quality .
Approach: They propose a framework for constraining neural models using logic rules to regularize them away from inconsistency.
Outcome: The proposed framework can be used on natural language inference and is compatible with off-the-shelf learning schemes without model redesign.
Identifying Human Strategies for Generating Word-Level Adversarial Examples (2022.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that word-level adversarial examples are more natural and grammatical correct than automated attacks.
Approach: They analyze how humans generate word-level adversarial examples against fine-tuned Transformer models that preserve naturalness and grammatical correctness.
Outcome: The authors show that humans generate adversarial examples much more effortlessly than automated attacks.
A Geometry-Inspired Attack for Generating Natural Language Adversarial Examples (2020.coling-main)

Copied to clipboard

Challenge: Existing techniques to generate adversarial examples for natural language are limited . previous research on adversarials focused on images, but this is not the case with natural language.
Approach: They propose a geometry-inspired attack for generating natural language adversarial examples . they use deep neural networks to iteratively approximate the decision boundary .
Outcome: The proposed attack fools natural language models with high success rates while replacing a few words.
A Reinforced Generation of Adversarial Examples for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Neural machine translation systems fail on less decent inputs, which may harm the credibility of these systems.
Approach: They propose a paradigm that generates adversarial examples using reinforcement learning to expose pitfalls for a given performance metric.
Outcome: The proposed paradigm produces stable attacks with meaning-preserving adversarial examples.
LogicAttack: Adversarial Attacks for Evaluating Logical Consistency of Natural Language Inference (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated impressive performance on Natural Language Inference (NLI) tasks.
Approach: They propose a method to attack NLI models using diverse logical forms of premise and hypothesis using propositional logic to generate effective adversarial attacks.
Outcome: The proposed method achieves an average 53% Attack Success Rate (ASR) across multiple logic-based attacks.
Attacking Visual Language Grounding with Adversarial Examples: A Case Study on Neural Image Captioning (P18-1)

Copied to clipboard

Challenge: Visual language grounding is widely studied in modern neural image captioning systems . a novel algorithm for crafting adversarial examples in image captions is proposed .
Approach: They propose an algorithm to craft adversarial examples in machine vision and perception . their approach provides two evaluation approaches to check if they can mislead systems .
Outcome: The proposed algorithm can craft visually-similar adversarial examples with randomly targeted captions or keywords, and the results are transferable to other image captioning systems.
Contrasting Human- and Machine-Generated Word-Level Adversarial Examples for Text Classification (2021.emnlp-main)

Copied to clipboard

Challenge: Recent work has raised the question of whether valid adversarial inputs are feasible.
Approach: They analyze how human-generated adversarial examples compare to the best algorithms . they use crowdsourcing to modify words in an input text with immediate feedback .
Outcome: The proposed algorithms are not more efficient than the best to generate natural-reading, sentiment-preserving examples.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations