Papers by Barry Wei
Decide less, communicate more: On the construct validity of end-to-end fact-checking in medicine (2026.findings-acl)
Copied to clipboard
Sebastian Antony Joseph, Lily Chen, Barry Wei, Michael Mackert, Iain James Marshall, Paul Pu Liang, Ramez Kouzy, Byron C Wallace, Junyi Jessy Li
| Challenge: | Evidence-based medicine connects to every individual, yet the nature of it is highly technical . e-fact-checking systems that connect to medical decisions are largely unused . we examine how clinical experts verify real claims from social media . |
| Approach: | They propose that fact-checking should be approached as an interactive communication problem . they argue that social media and AI have made medical knowledge accessible . |
| Outcome: | The proposed method is based on the work of a clinical expert on social media . it reveals that the method is difficult to connect claims to clinical trials . |
Assessing Factual Reliability of Large Language Model Knowledge (2024.naacl-long)
Copied to clipboard
| Challenge: | Factual knowledge of LLMs is typically evaluated using accuracy, yet this metric does not capture the vulnerability of LRMs to hallucination-inducing factors like prompt and context variability. |
| Approach: | They propose a metric designed to measure LLMs’ factual reliability by comparing the distance between the probability distributions of a valid output and its counterparts produced by the same LLM probing the same fact using different styles of prompts and contexts. |
| Outcome: | The proposed metric measures the distance between the probability distributions of a valid output and its counterparts produced by the same LLM probing the same fact using different styles of prompts and contexts. |