Papers by Pengkang Huo
SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for multimodal large language models fail to capture complexity and traceability of reasoning processes . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning. |
| Approach: | They propose a multimodal benchmark for scientific reasoning covering 54 subfields . SciVQR includes domain-specific visuals and challenges models to combine visual comprehension with reasoning . |
| Outcome: | SciVQR evaluates 54 subfields in mathematics, physics, chemistry, geography, astronomy, and biology . the results highlight the need for improved multi-step reasoning and integration of interdisciplinary knowledge . |
Can MLLMs Reason Beyond Language? VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in multimodal large language models demonstrate strong performance on visual reasoning benchmarks. |
| Approach: | They propose a benchmark for vision-centric reasoning that integrates visual and textual information for non-trivial reasoning. |
| Outcome: | The proposed benchmark exposes gaps between humans and current MLLMs and reveals limited benefits from test-time reasoning strategies. |