Trustworthy Medical Question Answering: An Evaluation-Centric Survey

Challenge:	achieving comprehensive trustworthiness in medical QA poses significant challenges due to complexity of healthcare data, critical nature of clinical scenarios, and multifaceted dimensions of trustworthy AI.
Approach:	They examine six key dimensions of trustworthiness in medical QA . they compare how each dimension is evaluated in existing LLM-based systems .
Outcome:	The findings show that large language models have improved patient safety and effectiveness . the models exhibit critical trust failures when deployed in clinical settings .

Similar Papers

Overview

Challenge

Approach

Outcome

A Comprehensive Survey on the Trustworthiness of Large Language Models in Healthcare (2025.findings-emnlp)

Copied to clipboard

Manar Aljohani, Jun Hou, Sindhura Kommu, Xuan Wang

Semantic Text Processing

Challenge:	a survey of large language models in healthcare raises critical concerns around trustworthiness . trustworthy of LLMs in healthcare remains underexplored, lacking a systematic review .
Approach:	a new survey examines the trustworthiness of large language models in healthcare . a review examines how each dimension affects reliability and ethical deployment of LLMs .
Outcome:	The present study examines the trustworthiness of large language models in healthcare . it identifies key gaps in existing approaches and challenges posed by evolving paradigms .

Truth, Trust, and Trouble: Medical AI on the Edge (2025.emnlp-industry)

Copied to clipboard

Mohammad Anas Azeez, Rafiq Ali, Ebad Shabbir, Zohaib Hasan Siddiqui, Gautam Siddharth Kashyap, Jiechao Gao, Usman Naseem

Challenge:	Large Language Models (LLMs) are promising for transforming digital health applications . but ensuring they meet industry standards for factual accuracy, usefulness, and safety remains a challenge .
Approach:	They present a framework to assess large language models' accuracy, usefulness, and safety . they assess models' honesty, helpfulness, harmlessness and domain-specific tuning .
Outcome:	The proposed framework assesses models across honesty, helpfulness, and harmlessness . AlpaCare-13B achieves highest accuracy (91.7%) and harmlessity (0.92) .

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering (2025.naacl-short)

Copied to clipboard

Anna Arias-Duart, Pablo Agustin Martin-Torres, Daniel Hinjos, Pablo Bernabeu-Perez, Lucia Urcelay Ganzabal, Marta Gonzalez Mallo, Ashwin Kumar Gururajan, Enrique Lopez-Cuena, Sergio Alvarez-Napagao, Dario Garcia-Gasulla

Question Answering

Challenge:	Current Large Language Models (LLMs) benchmarks are often based on open-ended or close-ended QA evaluations, avoiding the requirement of human labor.
Approach:	They propose a multi-axis suite for healthcare LLM evaluation, exploring correlations between open and close benchmarks and metrics.
Outcome:	The proposed framework explores correlations between open and close benchmarks and metrics in the healthcare domain, with blind spots and overlaps in existing methodologies.

LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation (2025.findings-emnlp)

Copied to clipboard

Ming Zhang, Yujiong Shen, Zelin Li, Huayu Sha, Binze Hu, Yuhui Wang, Chenhao Huang, Shichun Liu, Jingqi Tong, Changhao Jiang, Mingxu Chai, Zhiheng Xi, Shihan Dou, Tao Gui, Qi Zhang, Xuanjing Huang

Language Models

Challenge:	Current medical benchmarks have limitations in question design, data sources and evaluation methods.
Approach:	They propose a new benchmark covering five core medical areas . it includes 2,996 questions created from real-world electronic health records .
Outcome:	The proposed model covers five core medical areas and includes 2,996 questions created from real-world electronic health records and expert-designed clinical scenarios.

Mind the Gap: Benchmarking LLM Uncertainty and Calibration with Specialty-Aware Clinical QA and Reasoning-Based Behavioural Features (2026.eacl-long)

Copied to clipboard

Alberto Testoni, Iacer Calixto

Question Answering

Challenge:	Reliable uncertainty quantification (UQ) is essential when employing large language models in high-risk domains such as clinical question answering (QA).
Approach:	They evaluate uncertainty estimation methods for clinical question answering using eleven clinical specialties and six question types.
Outcome:	The proposed method is based on behavioral features derived from reasoning-oriented models and examines conformal prediction as a complementary set-based approach.

CliMedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models in Clinical Scenarios (2024.emnlp-main)

Copied to clipboard

Zetian Ouyang, Yishuai Qiu, Linlin Wang, Gerard De Melo, Ya Zhang, Yanfeng Wang, Liang He

Language Models

Challenge:	Chinese medical large language models (LLMs) are underperforming on this benchmark, especially where medical reasoning and factual consistency are vital.
Approach:	They propose a benchmark with 14 expert-guided clinical scenarios to assess the medical ability of large language models across 7 pivot dimensions.
Outcome:	The proposed benchmark has been validated in several ways.

From Scores to Steps: Diagnosing and Improving LLM Performance in Evidence-Based Medical Calculations (2025.emnlp-main)

Copied to clipboard

Benlu Wang, Iris Xia, Yifan Zhang, Junda Wang, null Feiyun Ouyang, Shuo Han, Arman Cohan, Hong Yu, Zonghai Yao

Reasoning

Challenge:	Existing benchmarks assess only the final answer with a wide numerical tolerance, overlooking systematic reasoning failures and potentially causing serious clinical misjudgments.
Approach:	They propose a new step-by-step evaluation pipeline that assesses formula selection, entity extraction, and arithmetic computation.
Outcome:	The proposed method improves the accuracy of large language models on medical benchmarks from 16.35% to 53.19%.

PEDANTS: Cheap but Effective and Interpretable Answer Equivalence (2024.findings-emnlp)

Copied to clipboard

Zongxia Li, Ishani Mondal, Huy Nghiem, Yijun Liang, Jordan Boyd-Graber

Explainability & Interpretability in NLP

Challenge:	Current short-form QA evaluations lack diverse styles of evaluation data and rely on expensive and slow LLMs.
Approach:	They propose a rubric for machine QA that is more stable than an exact match and neural methods.
Outcome:	The proposed evaluations improve on the existing short-form QA evaluations using the Trivia community.

AfriMed-QA: A Pan-African, Multi-Specialty, Medical Question-Answering Benchmark Dataset (2025.acl-long)

Copied to clipboard

Charles Nimo, Tobi Olatunji, Abraham Toluwase Owodunni, Tassallah Abdullahi, Emmanuel Ayodele, Mardhiyah Sanni, Ezinwanne C. Aka, Folafunmi Omofoye, Foutse Yuehgoh, Timothy Faniran, Bonaventure F. P. Dossou, Moshood O. Yekini, Jonas Kemp, Katherine A Heller, Jude Chidubem Omeke, Chidi Asuzu Md, Naome A Etori, Aïmérou Ndiaye, Ifeoma Okoh, Evans Doe Ocansey, Wendy Kinara, Michael L. Best, Irfan Essa, Stephen Edward Moore, Chris Fourie, Mercy Nyamewaa Asiedu

Question Answering

Challenge:	Recent advances in large language models (LLMs) performance on medical multiplechoice question (MCQ) benchmarks have stimulated interest from healthcare providers and patients globally.
Approach:	They introduce AfriMed-QA, the first largescale Pan-African English multi-specialty medical Question-Answering (QA) dataset, with 15,000 questions sourced from over 60 medical schools across 16 countries.
Outcome:	The proposed model outperforms other models in the medical field and is compared with other models.

How Robust Are Large Language Models for Clinical Numeracy? An Empirical Study on Numerical Reasoning Abilities in Clinical Contexts (2026.findings-acl)

Copied to clipboard

Minh-Vuong Nguyen, Fatemeh Shiri, Zhuang Li, Karin Verspoor

Robustness in NLP

Challenge:	Existing evaluations of Large Language Models for clinical numerical reasoning provide limited operation-level coverage and limited robustness of numerical understanding across clinical note formats.
Approach:	They propose a benchmarking tool that evaluates four main types of clinical numeracy . they present longitudinal MIMIC-IV vital-sign records in three semantically equivalent representations .
Outcome:	The proposed benchmark evaluates four main types of clinical numeracy: value retrieval, arithmetic computation, relational comparison, and aggregation.