LEGO: A Multi-agent Collaborative Framework with Role-playing and Iterative Feedback for Causality Explanation Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Causality explanation generation is a generative task that aims to explain why a given cause-effect pair is true using natural language. |
| Approach: | They propose a multi-agent framework with role-playing and iterative feedback for causality explanation generation. |
| Outcome: | The proposed framework is superior to existing frameworks on WIKIWHY and e-CARE datasets. |
Similar Papers
Explain-Analyze-Generate: A Sequential Multi-Agent Collaboration Method for Complex Reasoning (2025.coling-main)
Copied to clipboard
| Challenge: | Multiagent debate (MAD) is a popular approach for large language models . however, the performance of LLMs is suboptimal in complex reasoning scenarios . |
| Approach: | They propose a sequential collaboration framework to enable agents to provide constructive assistance to peers by decomposing complex tasks into essential subtasks. |
| Outcome: | The proposed framework achieves the highest performance on 19 out of 23 tasks and lower costs compared to MAD. |
From Generating Answers to Building Explanations: Integrating Multi-Round RAG and Causal Modeling for Scientific QA (2025.naacl-industry)
Copied to clipboard
Victor Barres, Clifton James McFate, Aditya Kalyanpur, Kailash Karthik Saravanakumar, Lori Moon, Natnael Seifu, Abraham Bautista-Castillo
| Challenge: | Application of Large Language Models to complex causal question answering can be stymied by their opacity and propensity for hallucination. |
| Approach: | They propose a causal QA approach that combines iterative RAG with a formal model of causation. |
| Outcome: | The proposed approach is implemented into a Collaborative Research Assistant (Cora) and evaluated in the life sciences domain. |
Bridging Internal Consistency and External Alignment: A Causal and Dynamic Interpretability Framework for LLM Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing interpretability methods focus on internal and external aspects of the model . existing explanations often focus on surface correlations or static dependencies . |
| Approach: | They propose a causal and dynamic interpretability framework for Large Language Models . they characterize backdoor-adjusted causal effects of generated prefix and prompt . |
| Outcome: | The proposed framework provides a unified causal view of internal consistency and external alignment in LLM generation dynamics. |
CAT: Causal Attention Tuning For Injecting Fine-grained Causal Knowledge into Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing fine-tuning paradigms focus on aligning LLMs with task-specific objectives. |
| Approach: | They propose a pipeline that leverages human priors to automatically generate token-level causal signals and introduce the Re-Attention mechanism to guide training. |
| Outcome: | The proposed pipeline achieves an average improvement of 5.76% on the STG dataset and 1.56% on downstream tasks. |
MAMM-Refine: A Recipe for Improving Faithfulness in Generation with Multi-Agent Collaboration (2025.naacl-long)
Copied to clipboard
| Challenge: | Multi-agent collaboration among models has shown promise in reasoning tasks but is underexplored in long-form generation tasks like summarization and question-answering. |
| Approach: | They propose a multi-agent multi-model reasoning recipe to improve faithfulness through refinement. |
| Outcome: | The proposed method improves faithfulness and error detection on three summarization datasets and on long-form question-answering tasks. |
ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | a new system that leverages the encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models (LLMs) is proposed to enhance the productivity of researchers . a researcher's research idea generation process involves problem identification, method development, experiment design and iterative revision . |
| Approach: | They propose a system that leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models to assist researchers in their work. |
| Outcome: | The proposed system generates novel ideas based on human and model-based evaluations . it leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models based systems . |
LLM Agents Implement an NLG System from Scratch: Building Interpretable Rule-Based RDF-to-Text Generators (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing neural approaches to generate RDF-to-text are limited in their implementation. |
| Approach: | They propose a framework where the model is “trained” through collaborative interactions among multiple LLM agents rather than traditional backpropagation. |
| Outcome: | The proposed framework reduces hallucinations and fluency penalties on the WebNLG and OpenDialKG datasets. |
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)
Copied to clipboard
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang
| Challenge: | Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability. |
| Approach: | They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality. |
| Outcome: | The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks. |
SAGE: An Agentic Explainer Framework for Interpreting SAE Features in Language Models (2026.eacl-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved remarkable progress, yet their internal mechanisms remain largely opaque. |
| Approach: | They propose an agent-based framework that recasts feature interpretation from a passive, single-pass generation task into an explanation-driven process. |
| Outcome: | The proposed framework produces explanations with significantly higher generative and predictive accuracy compared to state-of-the-art baselines. |
MAF: Multi-Aspect Feedback for Improving Reasoning in Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to enhance Language Models fail to address diverse error types . generic feedback is a bottleneck for addressing diverse errors in reasoning chains . |
| Approach: | They propose an iterative refinement framework that integrates multiple feedback modules . they propose to address errors in reasoning chains by integrating frozen LMs with external tools . |
| Outcome: | The proposed framework improves performance in Mathematical Reasoning and Logical Entailment by 20% and 18% respectively. |