Papers by Jim James
GeoRC: A Benchmark for Geolocation Reasoning Chains (2026.acl-long)
Copied to clipboard
Mohit Talreja, Joshua Diao, Jim James, Radu Casapu, Tejas Santanam, Ethan Mendes, Alan Ritter, Wei Xu, James Hays
| Challenge: | Vision Language Models (VLMs) are good at recognizing the global location of a photograph but are startlingly bad at explaining which image evidence led to their location prediction. |
| Approach: | They propose a benchmark for geolocation reasoning chains based on the global location prediction task in the popular GeoGuessr game. |
| Outcome: | The proposed benchmark compares LLM-as-a-judge and VLM-As-jumble strategies against human scoring. |
LAMP-MedQA: A Lightweight Multi-Agent System for Patient-Oriented Medical Question Answering (2026.acl-srw)
Copied to clipboard
| Challenge: | Large language models (LLMs) are a promising way to bridge the gap between patient health literacy and access to care. |
| Approach: | They evaluate a range of open- and closed-source LLMs on a MeDiSumQA dataset . they propose a lightweight multi-agent framework for patient-oriented medical question answering . |
| Outcome: | The proposed model achieves lower FKGL than zero-shot GPT-5 and highest simplification quality among all models. |