Visual Choice of Plausible Alternatives: An Evaluation of Image-based Commonsense Causal Reasoning (L18-1)
Copied to clipboard
Jinyoung Yeo, Gyeongbok Lee, Gengyu Wang, Seungtaek Choi, Hyunsouk Cho, Reinald Kim Amplayo, Seung-won Hwang
| Challenge: | Existing methods for evaluating plausibility of events are focused on measuring causal dependency between events or actions. |
| Approach: | They propose a task to identify the more plausible alternative with their commonsense causal context. |
| Outcome: | The proposed task is based on a visual COPA dataset with 380 questions and over 1K images with various topics. |
Similar Papers
COPA-SSE: Semi-structured Explanations for Commonsense Reasoning (2022.lrec-1)
Copied to clipboard
| Challenge: | Semi-structured explanations for Choice of Plausible Alternatives (COPA-SSE) are a crowdsourced dataset of 9,747 common sense explanations . |
| Approach: | They propose a semi-structured approach to explain Choice of Plausible Alternatives questions using a crowdsourced dataset of 9,747 common sense explanations with ConceptNet relations but freely written concepts. |
| Outcome: | The proposed explanations are geared towards commonsense reasoners operating on knowledge graphs and serve as a starting point for improving such systems. |
VCD: A Dataset for Visual Commonsense Discovery in Images (2025.findings-acl)
Copied to clipboard
| Challenge: | Visual commonsense data sets lack visual grounded representations of commonsensense . existing knowledge bases lack visual-based knowledge tied to actual visual scenes . |
| Approach: | They present a large-scale visual commonsense dataset with over 100,000 images and 14 million object-commonsense pairs that integrates both Seen (directly observable) and Unseen (inferrable) commonsens. |
| Outcome: | The proposed model integrates Seen (directly observable) and Unseen (inferrable) commonsense across Property, Action, and Space aspects. |
ViCor: Bridging Visual Understanding and Commonsense Reasoning with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for visual commonsense reasoning (VCR) use pre-trained large language models and pre-training visionlanguage models. |
| Approach: | They propose a collaborative approach where pre-trained LLMs serve as problem classifiers to analyze problem category and either use VLMs to answer directly or actively instruct LLM to gather relevant visual elements to support potential commonsense inferences. |
| Outcome: | The proposed approach outperforms all other methods without in-domain fine-tuning on two VCR benchmark datasets. |
Relevant CommonSense Subgraphs for “What if...” Procedural Reasoning (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge graphs and commonsense are used to learn causal reasoning over procedural text. |
| Approach: | They propose a multi-hop graph reasoning model to efficiently extract a commonsense subgraph with the most relevant information from a large knowledge graph and predict the causal answer by reasoning over the representations obtained from the commonsen subgraph and contextual interactions between the questions and context. |
| Outcome: | The proposed model achieves state-of-the-art on WIQA benchmark and is comparable to previous models. |
Zero-shot Commonsense Reasoning over Machine Imagination (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent approaches to zero-shot commonsense reasoning have suffered from human reporting bias inherent in textual commonsence knowledge, leading to discrepancies in understanding between PLMs and humans. |
| Approach: | They propose a zero-shot commonsense reasoning framework that integrates machine-generated images into the reasoning process. |
| Outcome: | The proposed framework outperforms existing methods on diverse reasoning benchmarks and analysis. |
Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Visual arguments rely on images to persuade viewers to do or believe something . |
| Approach: | They propose three tasks for evaluating visual argument understanding . they use visual premises, commonsense premises and reasoning trees to analyze visual arguments . |
| Outcome: | The proposed tasks evaluate visual argument understanding using a dataset of 1,611 images annotated with 5,112 visual premises (with regions), 5,574 commonsense premises, and reasoning trees connecting them into structured arguments. |
Com2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models (2025.acl-long)
Copied to clipboard
Kai Xiong, Xiao Ding, Yixin Cao, Yuxiong Yan, Li Du, Yufei Zhang, Jinglong Gao, Jiaqian Liu, Bing Qin, Ting Liu
| Challenge: | Existing works focus on complex tasks like math and code, while complex commonsense reasoning remains underexplored due to its uncertainty and lack of structure. |
| Approach: | They propose to build a benchmark for large language models based on complex commonsense reasoning based upon causal event graphs and causal theory. |
| Outcome: | The proposed benchmark combines a complex commonsense reasoning benchmark with a detective story to achieve a more challenging subset. |
The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Despite its significance, a systematic exploration of commonsense causality is lacking. |
| Approach: | They focus on taxonomies, benchmarks, acquisition methods, qualitative reasoning, and quantitative measurements in commonsense causality. |
| Outcome: | The proposed method synthesizes insights from over 200 representative articles and provides a practical guide for beginners. |
CELLO: Causal Evaluation of Large Vision-Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large vision-language models have improved causal reasoning abilities . however, current models struggle with tasks like causal reasoning . |
| Approach: | They propose a fine-grained and unified definition of causality involving interactions between humans and objects. |
| Outcome: | The proposed model surpasses traditional commonsense causality by including explicit causal graphs . it also shows that current LVLMs can benefit from a causally inspired prompting strategy . |
What’s Missing in Vision-Language Models? Probing Their Struggles with Causal Order Reasoning (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing benchmarks often include a mixture of reasoning questions, making it difficult to truly assess VLMs’ causal reasoning abilities. |
| Approach: | They propose two new benchmarks specifically designed to isolate and rigorously evaluate VLMs’ causal reasoning abilities. |
| Outcome: | The proposed benchmarks show that vision-language models perform poorly on causal reasoning tasks, often only marginally surpassing random guessing. |