A Robust Dual-debiasing VQA Model based on Counterfactual Causal Effect (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing VQA models suffer from language bias that indicates a spurious correlation between textual questions and answers. |
| Approach: | They propose a model agnostic dual-debiasing framework that models two types of language bias by separate branches under counterfactual inference framework. |
| Outcome: | The proposed framework significantly reduces language bias and achieves state-of-the-art performance on the benchmark datasets. |
Similar Papers
A Multi-modal Debiasing Model with Dynamical Constraint for Robust Visual Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that many well-developed Visual Question Answering systems suffer from bias problem. |
| Approach: | They propose a way to mitigate bias problem by subtracting bias score from standard VQA base score. |
| Outcome: | The proposed method improves on the VQA v2.0 and VQA-CP V2,0 datasets. |
Take Its Essence, Discard Its Dross! Debiasing for Toxic Language Detection via Counterfactual Causal Effect (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to mitigate lexical bias in toxic language detection (TLD) do not exploit the “useful” and “misleading” impact of the bias. |
| Approach: | They propose a counterfactual Causal Debiasing Framework to mitigate lexical bias in toxic language detection (TLD) it preserves the “useful impact” of lexical bias and eliminates the "misleading impact" they propose to use the same framework to analyze the causal effect of a sentence and bias tokens . |
| Outcome: | The proposed framework preserves the “useful impact” of lexical bias and eliminates the ‘misleading impact’ Empirical evaluations show that the proposed model outperforms current debiased models for out-of-distribution data. |
Counterfactual Inference for Text Classification Debiasing (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to capture unintended dataset biases are expensive and require elaborate balancing strategies. |
| Approach: | They propose a model-agnostic text classification debiasing framework which can effectively avoid employing data manipulations or designing balancing mechanisms. |
| Outcome: | The proposed framework can effectively avoid data manipulations or designing balancing mechanisms to capture unintended dataset biases. |
Mitigating Spurious Correlation in Natural Language Understanding with Counterfactual Inference (2022.emnlp-main)
Copied to clipboard
Can Udomcharoenchaikit, Wuttikorn Ponwitayarat, Patomporn Payoungkhamdee, Kanruethai Masuk, Weerayut Buaphet, Ekapol Chuangsuwanich, Sarana Nutanong
| Challenge: | Existing approaches to debias NLU models rely on superficial patterns to produce correct predictions . lexical overlap and annotation artifacts can be used to make shortcuts . |
| Approach: | They propose a causal analysis framework to help debias NLU models by defining causal relationships and utilizing counterfactual inference to mitigate bias. |
| Outcome: | The proposed framework can improve robustness across three NLU tasks while maintaining high in-distribution performance. |
Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have facilitated the development of Multimodal LLMs. |
| Approach: | They propose a causal framework to interpret unimodal biases in visual question answering problems and a framework to integrate information from different modalities and mitigate biase. |
| Outcome: | The proposed framework analyzes visual question answering (VQA) problems to assess their impact on predictions. |
DINER: Debiasing Aspect-based Sentiment Analysis with Multi-variable Causal Inference (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to debiase ABSA focus on single-variable causal inference . aspect-based sentiment analysis models are prone to learn spurious correlations from annotation biases . |
| Approach: | They propose a framework based on multivariable causal inference for debiasing ABSA . they propose to model different types of biases based upon different causal intervention methods . |
| Outcome: | The proposed framework tackles different types of biases based on different intervention methods. |
Large Language Models are Temporal and Causal Reasoners for Video Question Answering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable performances on a wide range of natural language understanding and generation tasks. |
| Approach: | They propose a framework that exploits linguistic shortcuts and mitigates 'linguistic bias' by flipping the source pair and target label to understand their complex relationships. |
| Outcome: | The proposed framework outperforms both LLMs-based and non-LLMs- based models on five challenging VideoQA benchmarks. |
Mitigating Language Bias of LMMs in Social Intelligence Understanding with Virtual Counterfactual Calibration (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on social intelligence using large multimodal models is under-explored due to the prevalence of text-based data in the pretraining stage. |
| Approach: | They propose a structure causal model to mitigate the negative language biases of large multimodal models by preserving beneficial priors. |
| Outcome: | The proposed model minimizes negative language bias while preserving beneficial priors while avoiding spurious correlations between LMMs' internal commonsense knowledge and the given context. |
Enhancing Event Causality Identification with Counterfactual Reasoning (2023.acl-short)
Copied to clipboard
| Challenge: | Existing methods for event causality identification (ECI) focus on mining potential causal signals, but causal signals are ambiguous, which may lead to the context-keywords bias and the event-pairs bias. |
| Approach: | They propose a method that explicitly estimates the influence of context keywords and event pairs in training to eliminate biases in inference. |
| Outcome: | The proposed method eliminates biases in inference on two datasets. |
Double Perturbation: On the Robustness of Robustness and Counterfactual Bias Evaluation (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that NLP models are vulnerable to adversarial perturbations such as synonym substitutions or syntax-guided paraphrasing. |
| Approach: | They propose a “double perturbation” framework to uncover model weaknesses beyond the test dataset. |
| Outcome: | The proposed attack achieves high success rates on both original and robustly trained CNNs and Transformers. |