JoPA: Explaining Large Language Model’s Generation via Joint Prompt Attribution (2025.acl-long)
Copied to clipboard
| Challenge: | Existing attempts to explain the entire language generation often treat input prompt texts independently, ignoring their combinatorial effects on the follow-up generation. |
| Approach: | They propose a framework for explaining how a few prompt texts collaboratively influences the LLM's complete generation. |
| Outcome: | The proposed explanations demonstrate faithfulness and efficiency of the proposed framework. |
Similar Papers
Prompting Large Language Models for Counterfactual Generation: An Empirical Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have made remarkable progress in a wide range of natural language understanding and generation tasks, but their ability to generate counterfactuals has not been examined systematically. |
| Approach: | They propose a framework to evaluate LLMs' ability to generate counterfactuals based on key factors including intrinsic properties and prompt design. |
| Outcome: | The proposed framework examines the strengths and weaknesses of large language models (LLMs) and identifies factors that influence their ability to generate counterfactuals. |
PromptPrism: A Linguistically-Inspired Taxonomy for Prompts (2026.findings-eacl)
Copied to clipboard
| Challenge: | PromptPrism is a linguistically-inspired taxonomy that enables prompt analysis across three hierarchical levels. |
| Approach: | They propose a linguistically-inspired taxonomy that enables prompt analysis across three hierarchical levels: functional structure, semantic component, and syntactic pattern. |
| Outcome: | The proposed taxonomy bridges traditional language understanding with modern LLM research . it improves prompt quality and improves model performance across tasks . |
PromptExplainer: Explaining Language Models through Prompt-based Learning (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing explanation methods rely on linear approximations, accentuating irrelevant input tokens. |
| Approach: | They propose a method that aligns the explanation process with the masked language modeling task of pretrained language models and leverages prompt-based learning to generate class-dependent explanations. |
| Outcome: | Extensive experiments show that PromptExplainer outperforms state-of-the-art explanation methods. |
Who Wrote it and Why? Prompting Large-Language Models for Authorship Verification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing AV techniques, including stylometric and deep learning, face limitations in terms of data requirements and lack of explainability. |
| Approach: | They propose a technique that leverages Large-Language Models (LLMs) to provide step-by-step stylometric explanation prompts to verify authorship. |
| Outcome: | The proposed technique outperforms state-of-the-art baselines, operates effectively with limited training data, and enhances interpretability through intuitive explanations. |
Prompting the Unknown: Understanding Response Uncertainty in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models are widely used in decision-making across diverse domains. |
| Approach: | They propose a prompt-response concept model that explains the relationship between the amount of task-relevant information provided in the prompt and the LLM-generated response uncertainty by identifying four sources of response uncertainty. |
| Outcome: | The proposed model shows that the amount of information provided in the prompt influences the LLM-generated response uncertainty. |
PMPO: Probabilistic Metric Prompt Optimization for Small and Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods evaluate candidate prompts by sampling full outputs, often coupled with self critique or human annotated preferences, which limits scalability, especially for smaller models or models that are not instruction tuned. |
| Approach: | They propose a framework that uses token level cross entropy as a direct, lightweight evaluation signal to evaluate candidate prompts. |
| Outcome: | The proposed framework outperforms prior prompt optimizers across model sizes and datasets. |
Attack Prompt Generation for Red Teaming and Defending Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies construct attack prompts via manual or automatic methods, but these methods have limitations on cost and quality. |
| Approach: | They propose an attack framework to instruct LLMs to mimic human-generated prompts through in-context learning and a defense framework that fine-tunes victim LLM's through iterative interactions with the attack framework. |
| Outcome: | The proposed approach is based on experiments on different LLMs to evaluate their effectiveness against red teaming attacks. |
Bridging Internal Consistency and External Alignment: A Causal and Dynamic Interpretability Framework for LLM Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing interpretability methods focus on internal and external aspects of the model . existing explanations often focus on surface correlations or static dependencies . |
| Approach: | They propose a causal and dynamic interpretability framework for Large Language Models . they characterize backdoor-adjusted causal effects of generated prefix and prompt . |
| Outcome: | The proposed framework provides a unified causal view of internal consistency and external alignment in LLM generation dynamics. |
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)
Copied to clipboard
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang
| Challenge: | Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability. |
| Approach: | They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality. |
| Outcome: | The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks. |
PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are useful for low-resource scenarios and time-restricted applications. |
| Approach: | They propose a large-scale evaluation tool for large language models that uses prompts . they evaluate 720 prompt templates for open-source LLM-based metrics on MT and summarization datasets a 6.6M evaluations. |
| Outcome: | The proposed model evaluates 720 prompt templates on machine translation and summarization datasets. |