Challenge: Existing studies focus on identifying existence of causality between two event mentions, but the direction of causalities is crucial for understanding the causal relation.
Approach: They propose to instruct a GLM to generate causality statements and identify directional event causality by evaluating the generated statements.
Outcome: The proposed method significantly outperforms state-of-the-art methods even with fewer training data.

Similar Papers

Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability.
Approach: They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality.
Outcome: The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks.
Causal Inference with Large Language Model: A Survey (2025.findings-naacl)

Copied to clipboard

Challenge: Existing causal inference frameworks do not match human judgment in several key areas, such as domain knowledge, logical inference, and cultural context.
Approach: They propose to apply large language models to causal inference tasks . they summarize the main causal problems and approaches and compare their results .
Outcome: The proposed methods are compared with traditional methods in healthcare, finance, and economics.
CausalEval: Towards Better Causal Reasoning in Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have been used for a variety of tasks, including problem-solving, decision-making, and understanding of the world.
Approach: They propose a review of existing methods aimed at enhancing LMs for causal reasoning . they categorize existing methods as reasoning engines or as helpers providing knowledge or data to traditional methods .
Outcome: The proposed methods perform better than existing methods on a range of tasks.
CausalityCheck: A Framework for Evaluating Causal Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation methods fail to accurately reflect a model's causal reasoning capabilities.
Approach: They propose a tool to automatically generate causal reasoning checklists to assess the causal reasoning abilities of 18 large language models.
Outcome: The proposed tool assesses the causal reasoning abilities of 18 large language models.
SEAG: Structure-Aware Event Causality Generation (2023.findings-acl)

Copied to clipboard

Challenge: Current methods for extracting event causality are limited by the lack of cross-task dependencies and may cause error propagation.
Approach: They propose an approach for Structure-Aware Event Causality Generation (SEAG) they generate the ECG structure using a pre-trained language model and perform structural discriminative training alongside auto-regressive generation.
Outcome: The proposed method is effective in extracting event causality from text.
The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code (2023.findings-acl)

Copied to clipboard

Challenge: entailment a)
Approach: entailment : We want to explore whether Code-LLMs with code prompts are better . encoding a code prompt is better than text-only LLMs, they say .
Outcome: entailment : Our results show that Code-LLMs with code prompts are better compared to text-only LLMs.
Pipeline for modeling causal beliefs from natural language (2023.acl-demo)

Copied to clipboard

Challenge: Existing methods to analyze language data for psychological causality are difficult to advance as they do not isolate cognitive mechanisms.
Approach: They propose a pipeline that leverages a Large Language Model to identify causal claims made in natural language documents and applies a clustering algorithm to group causal claims based on their semantic topics.
Outcome: The proposed pipeline analyzes the Covid-19 vaccine in tweets and generates a causal claim network.
Event Causality Identification with Synthetic Control (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to event causality identification have primarily utilized linguistic patterns and multi-hop relational inference, risking false causality .
Approach: They propose to use the Rubin Causal Model to identify event causality by generating a twin from existing corpora.
Outcome: The proposed method can identify causal relations more robustly than previous methods, including GPT-4, which is demonstrated on a causality benchmark, COPES-hard.
Bridging Internal Consistency and External Alignment: A Causal and Dynamic Interpretability Framework for LLM Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing interpretability methods focus on internal and external aspects of the model . existing explanations often focus on surface correlations or static dependencies .
Approach: They propose a causal and dynamic interpretability framework for Large Language Models . they characterize backdoor-adjusted causal effects of generated prefix and prompt .
Outcome: The proposed framework provides a unified causal view of internal consistency and external alignment in LLM generation dynamics.
CausalNLP Tutorial: An Introduction to Causality for Natural Language Processing (2022.emnlp-tutorials)

Copied to clipboard

Challenge: Establishing causal relationships is a fundamental goal of scientific research . lack of clear definitions, notations, benchmark datasets, and challenges remains .
Approach: They introduce the fundamentals of causal discovery and causal effect estimation to the natural language processing audience and provide an overview of causal perspectives to NLP problems.
Outcome: This tutorial introduces the fundamentals of causal discovery and causal effect estimation to the natural language processing audience and provides an overview of causal perspectives to NLP problems.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations