Detecting Causal Language Use in Science Findings (D19-1)

Copied to clipboard

Challenge: Prior studies on identifying inappropriate use of causal language relied on manual content analysis, which is not scalable for examining a large volume of science publications.
Approach: They developed a prediction model that classifies conclusion sentences into “no relationship”, “correlational”, “conditional causal” and “direct causal” categories.
Outcome: The proposed model can be used to identify the inappropriate use of causal language in scientific publications and news articles.

Similar Papers

Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond (2022.tacl-1)

Copied to clipboard

Challenge: causality has not had the same importance in natural language processing, says aaron e. smith . he says research on causality in NLP remains scattered across domains without unified definitions .
Approach: They propose to consolidate research on causality in NLP across academic areas . they explore potential uses of causal inference to improve robustness, fairness, interpretability .
Outcome: The proposed method is a unified overview of causal inference for the NLP community.
Challenges of Using Text Classifiers for Causal Inference (D18-1)

Copied to clipboard

Challenge: a number of scientific analyses focus on low-dimensional structured data, but text classifiers can be used to produce structured variables.
Approach: They propose to use text classifiers to conduct causal analyses on simulated and Yelp data.
Outcome: The proposed method can be used on simulated and Yelp data.
Causal Inference with Large Language Model: A Survey (2025.findings-naacl)

Copied to clipboard

Challenge: Existing causal inference frameworks do not match human judgment in several key areas, such as domain knowledge, logical inference, and cultural context.
Approach: They propose to apply large language models to causal inference tasks . they summarize the main causal problems and approaches and compare their results .
Outcome: The proposed methods are compared with traditional methods in healthcare, finance, and economics.
CLEAR: Can Language Models Really Understand Causal Graphs? (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing language models lack a conceptual framework for understanding causal graphs, but there is still potential for improvement.
Approach: They develop a framework to define causal graph understanding by assessing language models’ behaviors through four practical criteria derived from diverse disciplines.
Outcome: The proposed framework defines three complexity levels and encompasses 20 causal graph-based tasks across 20 different levels.
CausalEval: Towards Better Causal Reasoning in Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have been used for a variety of tasks, including problem-solving, decision-making, and understanding of the world.
Approach: They propose a review of existing methods aimed at enhancing LMs for causal reasoning . they categorize existing methods as reasoning engines or as helpers providing knowledge or data to traditional methods .
Outcome: The proposed methods perform better than existing methods on a range of tasks.
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability.
Approach: They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality.
Outcome: The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks.
CausalNLP Tutorial: An Introduction to Causality for Natural Language Processing (2022.emnlp-tutorials)

Copied to clipboard

Challenge: Establishing causal relationships is a fundamental goal of scientific research . lack of clear definitions, notations, benchmark datasets, and challenges remains .
Approach: They introduce the fundamentals of causal discovery and causal effect estimation to the natural language processing audience and provide an overview of causal perspectives to NLP problems.
Outcome: This tutorial introduces the fundamentals of causal discovery and causal effect estimation to the natural language processing audience and provides an overview of causal perspectives to NLP problems.
Pipeline for modeling causal beliefs from natural language (2023.acl-demo)

Copied to clipboard

Challenge: Existing methods to analyze language data for psychological causality are difficult to advance as they do not isolate cognitive mechanisms.
Approach: They propose a pipeline that leverages a Large Language Model to identify causal claims made in natural language documents and applies a clustering algorithm to group causal claims based on their semantic topics.
Outcome: The proposed pipeline analyzes the Covid-19 vaccine in tweets and generates a causal claim network.
Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimates (2020.acl-main)

Copied to clipboard

Challenge: Unmeasured or latent confounders can bias causal estimates and this has motivated interest in measuring potential confounder from observed text.
Approach: They propose to use text to measure potential confounders in a way that allows for a rich measurement of multiple confounder variables.
Outcome: The proposed method is based on an individual’s entire history of social media posts or the content of a news article.
On the Reliability of Large Language Models for Causal Discovery (2025.acl-long)

Copied to clipboard

Challenge: Existing statistical methods to identify causal relationships from observational data remain elusive.
Approach: They examine the impact of memorization for accurate causal relation prediction, the influence of incorrect causal relations in pre-training data and the contextual nuances that influence LLMs’ understanding of causal relations.
Outcome: The proposed models are effective in recognizing causal relations that occur frequently in pre-training data, but their ability to generalize to new or rare causal relations is limited.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations