Papers by Ramez Kouzy
Faithfulness vs. Safety: Evaluating LLM Behavior Under Counterfactual Medical Evidence (2026.findings-acl)
Copied to clipboard
Kaijie Mo, Siddhartha Venkatayogi, Chantal Shaib, Ramez Kouzy, Wei Xu, Byron C Wallace, Junyi Jessy Li
| Challenge: | Existing models are overwhelmingly accurate when presented with counterfactual medical evidence . prior work explored conflicts between context and LLM parametric knowledge in the general domain . |
| Approach: | They construct a counterfactual medical QA dataset that requires models to answer clinical comparison questions with evidence from randomized controlled trials. |
| Outcome: | The proposed model overemphasizes the latter, and the model overestimates the latter. |
Decide less, communicate more: On the construct validity of end-to-end fact-checking in medicine (2026.findings-acl)
Copied to clipboard
Sebastian Antony Joseph, Lily Chen, Barry Wei, Michael Mackert, Iain James Marshall, Paul Pu Liang, Ramez Kouzy, Byron C Wallace, Junyi Jessy Li
| Challenge: | Evidence-based medicine connects to every individual, yet the nature of it is highly technical . e-fact-checking systems that connect to medical decisions are largely unused . we examine how clinical experts verify real claims from social media . |
| Approach: | They propose that fact-checking should be approached as an interactive communication problem . they argue that social media and AI have made medical knowledge accessible . |
| Outcome: | The proposed method is based on the work of a clinical expert on social media . it reveals that the method is difficult to connect claims to clinical trials . |