ECHo: A Visio-Linguistic Dataset for Event Causality Inference via Human-Centric Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | ECHo is a diagnostic dataset of event causality inference grounded in visio-linguistic social scenarios. |
| Approach: | They propose a diagnostic dataset of event causality inference grounded in visio-linguistic social scenarios. |
| Outcome: | The proposed framework examines the reasoning capability of current AI systems on three human-centric tasks. |
Similar Papers
Event Causality Is Key to Computational Story Understanding (2024.naacl-long)
Copied to clipboard
| Challenge: | Cognitive science and symbolic AI research suggest that event causality provides vital information for story understanding. |
| Approach: | They propose a method for event causality identification that leads to material improvements in story understanding. |
| Outcome: | The proposed method improves story understanding on the COPES dataset . it achieves 4.1-10.9% increase on Clip Accuracy and 4.2-13.5% increase on Sentence IoU . |
Event2Mind: Commonsense Inference on Events, Intents, and Reactions (P18-1)
Copied to clipboard
| Challenge: | Using a crowdsourced corpus of 25,000 event phrases, we construct a new task that uses commonsense reasoning to reason about the likely intents and reactions of the event participants. |
| Approach: | They construct a crowdsourced corpus of 25,000 event phrases and use them to construct 'commonsense inference' they demonstrate that neural encoder-decoder models can compose embedding representations of previously unseen events and reason about the likely intents and reactions of the event participants. |
| Outcome: | The proposed task can be used to uncover implicit gender inequality in movie scripts. |
COMET-M: Reasoning about Multiple Events in Complex Sentences (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing commonsense models that generate event-centric inferences for simple sentences struggle with the complexity of multi-event sentences prevalent in natural text. |
| Approach: | They propose a commonsense model that generates inferences for a target event within a complex sentence using a multi-event inference dataset. |
| Outcome: | The proposed model produces inferences for a target event within a complex sentence taking the complete context into account. |
A Method for Building a Commonsense Inference Dataset based on Basic Events (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to acquire commonsense are limited by the general-purpose language models. |
| Approach: | They propose a method for building a commonsense inference dataset using crowdsourcing and automatic extraction from a corpus. |
| Outcome: | The proposed method can solve 104k commonsense inference problems in a Japanese corpus with high accuracy, but low bias. |
CELLO: Causal Evaluation of Large Vision-Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large vision-language models have improved causal reasoning abilities . however, current models struggle with tasks like causal reasoning . |
| Approach: | They propose a fine-grained and unified definition of causality involving interactions between humans and objects. |
| Outcome: | The proposed model surpasses traditional commonsense causality by including explicit causal graphs . it also shows that current LVLMs can benefit from a causally inspired prompting strategy . |
CausalityCheck: A Framework for Evaluating Causal Reasoning in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation methods fail to accurately reflect a model's causal reasoning capabilities. |
| Approach: | They propose a tool to automatically generate causal reasoning checklists to assess the causal reasoning abilities of 18 large language models. |
| Outcome: | The proposed tool assesses the causal reasoning abilities of 18 large language models. |
How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models excel at capturing semantic correlations within utterance embeddings but fail to determine specific causal relationships. |
| Approach: | They propose to incorporate i.i.d. noise terms into conversation process to build a structural causal model . they propose to use unstructured conversation data to facilitate deep learning . |
| Outcome: | The proposed approach can be implemented in unstructured conversation data and a synthetic dataset that includes i.i.d. noise. |
e-CARE: a New Dataset for Exploring Explainable Causal Reasoning (2022.acl-long)
Copied to clipboard
| Challenge: | Existing causal reasoning models only learn to induce empirical causal patterns that are predictive to the label, while human beings seek for deep and conceptual understanding of the causality to explain the observed causal facts. |
| Approach: | They present a human-annotated CAusal REasoning dataset with conceptual explanations of the causality. |
| Outcome: | The presented dataset shows that human-annotated explanations can be useful for promoting the accuracy and stability of causal reasoning models. |
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)
Copied to clipboard
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang
| Challenge: | Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability. |
| Approach: | They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality. |
| Outcome: | The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks. |
Causal Inference of Script Knowledge (2020.emnlp-main)
Copied to clipboard
| Challenge: | Prior work on script induction relied on correlation between instances of events in corpus . instead, we propose an approach based on causal effects between events . |
| Approach: | They propose to use causal effects to induce scripts from text . they propose to compute a function that matches the intuition of what a script represents . |
| Outcome: | The proposed method matches the intuition of what a script represents, the authors show . |