Papers by Demet Yuksel
Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are often evaluated using multiple-choice questions (MCQs) modeled on exams like the USMLE. |
| Approach: | They created a fictional medical benchmark centered on an imaginary organ, the Glianorex, to separate memorized knowledge from reasoning ability. |
| Outcome: | The proposed model outperforms base models in English but not in French. |