Challenge: Existing VQA tests lack superficial correlations and other weaknesses, which lead to optimistic evaluations when considering accuracy alone.
Approach: They introduce a system to measure consistency and robustness of modern VQA models through a series of six fine-grained capability tests.
Outcome: The proposed test suite evaluates six modern VQA systems and identifies several actionable weaknesses in model comprehension.

Similar Papers

Sunny and Dark Outside?! Improving Answer Consistency in VQA through Entailed Question Generation (D19-1)

Copied to clipboard

Challenge: interacting with a model for Visual Question Answering (VQA) quickly reveals that these models lack consistency.
Approach: They propose a dataset, ConVQA, and metrics that enable quantitative evaluation of consistency in VQA.
Outcome: The proposed data augmentation module improves the consistency of VQA models on the Con-VQA dataset and is a strong baseline for future research.
Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness (2024.findings-emnlp)

Copied to clipboard

Challenge: Chart question answering (CQA) is a crucial area of Visual Language Understanding.
Approach: They evaluate the robustness and consistency of current Visual Language Models on a dataset encompassing diverse question categories and chart formats.
Outcome: The proposed models handle varying levels of chart and question complexity and are robust across different visual representations of the same underlying data.
Are VQA Systems RAD? Measuring Robustness to Augmented Data with Focused Interventions (2021.acl-short)

Copied to clipboard

Challenge: Existing systems for visual question answering are overfitted to training data and are sensitive to small perturbations.
Approach: They propose a robustness measure to augment visual question answering datasets to measure generalization capabilities.
Outcome: The proposed model can quantify failure cases which reveal that current systems are still brittle.
SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models (2025.naacl-industry)

Copied to clipboard

Challenge: Typical evaluations of Large Language Models (LLMs) report a single accuracy metric per dataset, often derived from an optimized setup.
Approach: They propose a framework for non-adversarial evaluation of large language models that evaluates models by repeatedly testing them on the same benchmarks in various setups.
Outcome: The proposed framework evaluates models by repeatedly testing them on the same benchmarks in various setups to give a realistic estimate of their accuracy and consistency.
MM-R3: On (In-)Consistency of Vision-Language Models (VLMs) (2025.findings-acl)

Copied to clipboard

Challenge: a flurry of research has been conducted on the performance of state-of-the-art (SoTA) Vision Language Models (VLMs) on a variety of tasks.
Approach: They propose a benchmarking tool to analyze performance of SoTA Vision Language Models (VLMs) on three tasks: Question Rephrasing, Image Restyling, and Context Reasoning.
Outcome: The proposed model achieves absolute improvements of 5.7% and 12.5% on widely used VLMs such as BLIP-2 and LLaVa 1.5M in terms of consistency over their existing counterparts.
RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing QA models are not robust to variations in question constraints, but can be made more robust by tuning on clusters of related questions.
Approach: They introduce RoMQA, the first benchmark for robust, multi-evidence, multianswer question answering (QA) RoMQ contains clusters of related questions that are derived from the Wikidata knowledge graph .
Outcome: The proposed model is the first benchmark for robust, multi-evidence, multianswer question answering (QA) compared to prior QA datasets, it has more human-written questions that require reasoning over more evidence text and have, on average, many more correct answers.
CrossVQA: Scalably Generating Benchmarks for Systematically Testing VQA Generalization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing visual question answering models leverage spurious biases and take shortcuts to improve performance.
Approach: They propose a semi-automatic framework for generating disentangled shifts by introducing a controllable visual question-answer generation module that generates highly-relevant question-announcer pairs with the desired dataset style.
Outcome: The proposed framework generates highly-relevant and diverse question-answer pairs with the desired dataset style.
A Novel Metric for Measuring the Robustness of Large Language Models in Non-adversarial Scenarios (2024.findings-emnlp)

Copied to clipboard

Challenge: Using large language models, we evaluated their robustness on multiple datasets.
Approach: They propose a new metric for assessing model robustness by empirical evaluation of several models on multiple datasets.
Outcome: The proposed metric is based on a set of datasets that are constructed by introducing naturally-occurring, non-malicious perturbations or by generating semantically equivalent paraphrases of input questions or statements.
Exploring The Landscape of Distributional Robustness for Question Answering Models (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for predicting distributional robustness fail to generalize reliably in a variety of test conditions.
Approach: They conduct a large empirical evaluation to investigate the landscape of distributional robustness in question answering.
Outcome: The proposed methods are more robust to distribution shifts than fully fine-tuned models, and few-shot prompt models exhibit better robustness than few- shot prompt models.
Can Pre-training help VQA with Lexical Variations? (2020.findings-emnlp)

Copied to clipboard

Challenge: Visual Question Answering (VQA) models are closing the gap between oracle performance and model robustness.
Approach: They propose to use language & cross-modal pre-training to investigate the robustness of VQA models towards lexical variations.
Outcome: The proposed model architectures and training techniques improve the performance of the VQA-Rephrasings dataset on rephrased questions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations