Challenge: Large language models (LLMs) have shown remarkable progress in reasoning across multiple domains, but it remains unclear whether their abilities reflect genuine reasoning or sophisticated pattern matching.
Approach: They conduct one of the largest evaluations to date, assessing 77 LLMs . they select three medical question answering (QA) benchmarks targeting reasoning processes .
Outcome: The results highlight the need to improve specific reasoning strategies to better reflect medical decision-making.

Similar Papers

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on evaluating large language models in close-ended QA tasks, but many clinical decisions involve answering open-ended questions without pre-set options.
Approach: They construct a benchmark to better understand large language models in the clinic . they use existing datasets to evaluate LLMs in clinical situations .
Outcome: The proposed model outperforms human experts in multiple medical tasks.
Current Advances in LLM Reasoning (2026.acl-tutorials)

Copied to clipboard

Challenge: This tutorial examines comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) advanced inference time methods and post-training methods that aim to make LLMs think more like humans are discussed in this tutorial.
Approach: This tutorial explores comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) and discusses two types of methods to improve models’ reasoning: advanced inference time methods, structured and self-improvement inference methods, and post-training methods, such as RLHF, DPO, and GRPO.
Outcome: This tutorial examines evaluation strategies to assess the reasoning abilities of large language models and discusses two types of methods to improve models’ reasoning.
A Survey of LLM-based Agents in Medicine: How far are we from Baymax? (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are transforming healthcare through their ability to understand and assist with medical tasks.
Approach: They analyze system profiles, clinical planning, medical reasoning frameworks, and external capacity enhancement.
Outcome: The findings highlight the future directions in medical reasoning, physical system integration, and training simulations.
Facts Fade Fast: Evaluating Memorization of Outdated Medical Knowledge in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: LLMs encode extensive knowledge within their parameters, but the knowledge in LLM models can become outdated over time.
Approach: They propose two new LLMs that provide outdated medical advice . they compare the models with a set of QA pairs whose verdict changed through time .
Outcome: The proposed models exhibit memorization of outdated knowledge to some extent.
Towards Reasoning in Large Language Models: A Survey (2023.findings-acl)

Copied to clipboard

Challenge: Reasoning is a fundamental aspect of human intelligence that plays a crucial role in many intellectual activities.
Approach: They propose to improve LLMs' ability to elicit reasoning by providing exemplars or prompts to model reasoning.
Outcome: This paper provides a comprehensive overview of the state of knowledge on reasoning in large language models.
Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are often evaluated using multiple-choice questions (MCQs) modeled on exams like the USMLE.
Approach: They created a fictional medical benchmark centered on an imaginary organ, the Glianorex, to separate memorized knowledge from reasoning ability.
Outcome: The proposed model outperforms base models in English but not in French.
LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Current medical benchmarks have limitations in question design, data sources and evaluation methods.
Approach: They propose a new benchmark covering five core medical areas . it includes 2,996 questions created from real-world electronic health records .
Outcome: The proposed model covers five core medical areas and includes 2,996 questions created from real-world electronic health records and expert-designed clinical scenarios.
Assessing and Mitigating Medical Knowledge Drift and Conflicts in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Rapid medical concept drift can lead LLMs to provide incorrect or outdated advice.
Approach: They propose to evaluate how large language models manage knowledge conflicts in clinical guidelines.
Outcome: The proposed benchmark evaluates how LLMs manage varied knowledge conflicts in clinical guidelines.
Do Large Language Models excel in Complex Logical Reasoning with Formal Language? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies on LLMs have focused on formal language, but evaluations of their performance are limited.
Approach: They propose to use a formal language to evaluate LLMs across logical reasoning problems using formal languages.
Outcome: The proposed model outperforms Instruct models in three dimensions, taxonomy of tasks, and format of trajectories, and achieves the best generalization performance across other languages.
MedREQAL: Examining Medical Knowledge Recall of Large Language Models via Question Answering (2024.findings-acl)

Copied to clipboard

Challenge: Large language models can encode knowledge during pre-training on large text corpora, enabling downstream tasks like question answering (QA).
Approach: They construct a dataset derived from systematic reviews to examine their ability to encode medical knowledge and their recall.
Outcome: The proposed model performs well on the biomedical QA dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations