Faithfulness vs. Safety: Evaluating LLM Behavior Under Counterfactual Medical Evidence (2026.findings-acl)
Copied to clipboard
Kaijie Mo, Siddhartha Venkatayogi, Chantal Shaib, Ramez Kouzy, Wei Xu, Byron C Wallace, Junyi Jessy Li
| Challenge: | Existing models are overwhelmingly accurate when presented with counterfactual medical evidence . prior work explored conflicts between context and LLM parametric knowledge in the general domain . |
| Approach: | They construct a counterfactual medical QA dataset that requires models to answer clinical comparison questions with evidence from randomized controlled trials. |
| Outcome: | The proposed model overemphasizes the latter, and the model overestimates the latter. |
Similar Papers
Do LLMs Behave as Claimed? Investigating How LLMs Follow Their Own Claims using Counterfactual Questions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation frameworks rely on curated datasets that, once public, may be accessed by newer LLMs. |
| Approach: | They propose a framework that generates counterfactual questions and answers from existing evaluation datasets and uses them to evaluate LLMs. |
| Outcome: | The proposed evaluation framework reduces the risk of data leakage by allowing the LLMs to respond to counterfactual questions and verify their claims. |
Sycophants in the Courtroom: Are LLMs Fragile to Juridical Authority and Evolving Legal Standards? (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances have seen large language models (LLMs) achieve remarkable performance across high-stakes specialized domains. |
| Approach: | They propose a diagnostic framework that evaluates legal reasoning against medical baselines along four axes (knowledge recall, grounding, confidence, and robustness) they uncover a sharp domain asymmetry when applied to a benchmark that encodes temporal validity and normative relationships. |
| Outcome: | The proposed framework evaluates legal reasoning against medical baselines along four axes (knowledge recall, grounding, confidence, and robustness) it shows that legal LLMs struggle to assess when retrieved citations are useful or misleading, exhibiting overconfidence in perturbed contexts and sensitivity to superficial formatting cues. |
Faithful Serum: Mitigating the Faithfulness Gap in Textual Explanations of LLM Decisions via Attribution Guidance (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work has focused on generating convincing rationales that appear to be subjectively faithful, but it remains unclear whether these explanations are epistemic faithful. |
| Approach: | They propose a method that enhances epistemic faithfulness by guiding explanation generation through attention-level interventions, informed by token-level heatmaps. |
| Outcome: | The proposed method significantly improves epistemic faithfulness across multiple models, benchmarks, and prompts. |
Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly employed as automated evaluators to assess the safety of generated content. |
| Approach: | They evaluate 11 LLM judge models across critical safety domains . apologetic language artifacts alone can skew evaluator preferences by up to 98% . |
| Outcome: | The findings show that apologetic language artifacts alone can skew evaluator preferences by up to 98% . |
MedRedFlag: Investigating how LLMs Redirect Misconceptions in Real-World Health Communication (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly being used by lay users for medical advice, but they have not yet been tested for this crucial competency. |
| Approach: | They develop a semi-automated pipeline to curate MedRedFlag, a dataset of 1100+ reddit questions that require redirection. |
| Outcome: | The proposed pipeline compares state-of-the-art LLMs to those from clinicians to find out how they perform under real-world health communication. |
Appraising the Potential Uses and Harms of LLMs for Medical Systematic Reviews (2023.emnlp-main)
Copied to clipboard
| Challenge: | Medical systematic reviews are time-consuming and often generate inaccurate outputs . authors: a model that generates scientific-sounding outputs can be unusable at best . |
| Approach: | They conduct interviews with systematic review experts to characterize perceived utility and risks of LLMs in medical evidence reviews. |
| Outcome: | a new study characterizes perceived utility and risks of medical evidence reviews . experts say they can assist in the writing process by drafting summaries, distilling information . authors say they expect the model to be more accurate and more reliable . |
Knowing When to Abstain: Medical LLMs Under Clinical Uncertainty (2026.eacl-long)
Copied to clipboard
Sravanthi Machcha, Sushrita Yerra, Sahil Gupta, Aishwarya Sahoo, Sharmin Sultana, Hong Yu, Zonghai Yao
| Challenge: | Current evaluation of large language models prioritizes accuracy, but abstention is vital for trustworthy deployment. |
| Approach: | They propose a benchmark and evaluation protocol for abstention in medical multiple-choice question answering . they integrate conformal prediction, adversarial question perturbations, and explicit abstraction options. |
| Outcome: | The proposed protocol improves reliability of medical multiple-choice question answering models by providing explicit abstention options. |
MedEinst: Benchmarking the Einstellung Effect in Medical LLMs through Counterfactual Differential Diagnosis (2026.acl-long)
Copied to clipboard
| Challenge: | Existing medical benchmarks fail to detect the Einstellung Effect in clinical diagnosis . Existing models exhibit the Einstellung effect, relying on statistical shortcuts rather than logical reasoning. |
| Approach: | They propose a counterfactual benchmark that uses statistical shortcuts to diagnose patients . they propose CGME-based system that iteratively refines reasoning paths . |
| Outcome: | The proposed model achieves high baseline accuracy but severe bias trap rates . iteratively refines reasoning paths in an exemplar base and consolidates disease-specific knowledge into illness graphs. |
MetaFaith: Faithful Natural Language Uncertainty Expression in LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for faithful calibration of large language models (LLMs) are insufficient and can harm faithful calibration. |
| Approach: | They propose a new prompt-based calibration approach inspired by human metacognition that measures faithfulness across diverse models and task domains and enables up to 61% improvement in faithfulness. |
| Outcome: | The proposed approach improves faithfulness across diverse models and task domains and achieves an 83% win rate over original generations as judged by humans. |
LIBERTy: A Causal Framework for Benchmarking Concept-Based Explanations of LLMs with Structural Counterfactuals (2026.findings-acl)
Copied to clipboard
| Challenge: | Concept-based explanations quantify how high-level concepts influence model behavior . existing benchmarks rely on costly human-written counterfactuals that serves as imperfect proxy . |
| Approach: | They propose a framework for constructing datasets containing structural counterfactual pairs . they use a structured Causal Model to generate a concept-based explanation . |
| Outcome: | The proposed framework compares concept-based explanations to causal effects estimated from counterfactuals. |