A Multi-Level Benchmark for Causal Language Understanding in Social Media Discourse (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets focus on explicit causality in structured text, providing limited support for detecting implicit causal expressions. |
| Approach: | They propose a dataset of Reddit posts annotated across four causal tasks . they use a binary causal classification, explicit vs. implicit causality, cause–effect span extraction and causal gist generation to bridge causal detection and reasoning over informal discourse. |
| Outcome: | The proposed dataset analyzes 10,120 Reddit posts discussing public health related to the COVID-19 pandemic. |
Similar Papers
The Causal News Corpus: Annotating Causal Relations in Event Sentences from News (2022.lrec-1)
Copied to clipboard
Fiona Anting Tan, Ali Hürriyetoğlu, Tommaso Caselli, Nelleke Oostdijk, Tadashi Nomoto, Hansi Hettiarachchi, Iqra Ameer, Onur Uca, Farhana Ferdousi Liza, Tiancheng Hu
| Challenge: | Existing annotation guidelines for event causality focus on only explicit relations or clauses. |
| Approach: | They propose an annotation schema for event causality that addresses these concerns . they annotated 3,559 event sentences from protest event news with labels on whether it contains causal relations or not. |
| Outcome: | The proposed annotation schema for event causality addresses these concerns . it performs well with 81.20% F1 score on test set and 83.46% in 5-folds cross-validation . |
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)
Copied to clipboard
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang
| Challenge: | Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability. |
| Approach: | They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality. |
| Outcome: | The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks. |
CausalNLP Tutorial: An Introduction to Causality for Natural Language Processing (2022.emnlp-tutorials)
Copied to clipboard
| Challenge: | Establishing causal relationships is a fundamental goal of scientific research . lack of clear definitions, notations, benchmark datasets, and challenges remains . |
| Approach: | They introduce the fundamentals of causal discovery and causal effect estimation to the natural language processing audience and provide an overview of causal perspectives to NLP problems. |
| Outcome: | This tutorial introduces the fundamentals of causal discovery and causal effect estimation to the natural language processing audience and provides an overview of causal perspectives to NLP problems. |
Exploring the Potential of ChatGPT on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations (2024.findings-eacl)
Copied to clipboard
| Challenge: | Recent studies have demonstrated ChatGPT's remarkable few-shot, even zero-shot learning abilities when compared to other models. |
| Approach: | They quantitatively evaluate the performance of ChatGPT on inter-sentential relations such as temporal relations, causal relations, and discourse relations. |
| Outcome: | The proposed model performs well on temporal relations, causal relations, and discourse relations. |
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond (2022.tacl-1)
Copied to clipboard
Amir Feder, Katherine A. Keith, Emaad Manzoor, Reid Pryzant, Dhanya Sridhar, Zach Wood-Doughty, Jacob Eisenstein, Justin Grimmer, Roi Reichart, Margaret E. Roberts, Brandon M. Stewart, Victor Veitch, Diyi Yang
| Challenge: | causality has not had the same importance in natural language processing, says aaron e. smith . he says research on causality in NLP remains scattered across domains without unified definitions . |
| Approach: | They propose to consolidate research on causality in NLP across academic areas . they explore potential uses of causal inference to improve robustness, fairness, interpretability . |
| Outcome: | The proposed method is a unified overview of causal inference for the NLP community. |
Causal Explanation Analysis on Social Media (D18-1)
Copied to clipboard
| Challenge: | Understanding causal explanations is an important psychological factor linked to physical and mental health. |
| Approach: | They propose to automate causal explanation analysis by building on discourse parsing and using a hierarchy of Bidirectional LSTMs to identify the specific phrase that is the explanation. |
| Outcome: | The proposed subtasks achieve strong accuracies but differ in their approaches . the proposed sub task is compared with the previous task and is able to identify the specific phrase that is the explanation. |
CausalDialogue: Modeling Utterance-level Causality in Conversations (2023.findings-acl)
Copied to clipboard
| Challenge: | Despite widespread adoption, neural conversation models have yet to exhibit natural chat capabilities with humans . despite their widespread adoption in society, chatbots have yet not shown natural chat capability . |
| Approach: | They propose a causality-enhanced method to enhance the impact of causality at the utterance level in training neural conversation models. |
| Outcome: | The proposed method improves diversity and agility of loss functions and still needs improvement . the proposed method is based on a CausalDialogue dataset . |
Causal Inference with Large Language Model: A Survey (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing causal inference frameworks do not match human judgment in several key areas, such as domain knowledge, logical inference, and cultural context. |
| Approach: | They propose to apply large language models to causal inference tasks . they summarize the main causal problems and approaches and compare their results . |
| Outcome: | The proposed methods are compared with traditional methods in healthcare, finance, and economics. |
Can Large Language Models Infer Causal Relationships from Real-World Text? (2026.acl-long)
Copied to clipboard
| Challenge: | Existing work evaluating large language models relies on synthetic or simplified texts with explicit causal relationships. |
| Approach: | They develop a benchmark to evaluate LLMs' ability to infer causal relationships from texts . they use a dataset of texts with different levels of explicitness and complexity . |
| Outcome: | The proposed benchmark is the first-ever real-world dataset for this task. |
Pipeline for modeling causal beliefs from natural language (2023.acl-demo)
Copied to clipboard
| Challenge: | Existing methods to analyze language data for psychological causality are difficult to advance as they do not isolate cognitive mechanisms. |
| Approach: | They propose a pipeline that leverages a Large Language Model to identify causal claims made in natural language documents and applies a clustering algorithm to group causal claims based on their semantic topics. |
| Outcome: | The proposed pipeline analyzes the Covid-19 vaccine in tweets and generates a causal claim network. |