ChemVLR: Prioritizing Reasoning in Perception for Chemical Vision-Language Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Currently, vision-Language Models are optimized for direct visual question-answering tasks. |
| Approach: | They propose a visual-language-based VLM that prioritizes reasoning within the perception process. |
| Outcome: | The proposed model outperforms existing models and domain-specific open-source models in the chemical domain. |
Similar Papers
CheMM-R1: Enhancing Chemical Structure Recognition and Elucidation with Reasoning Multimodal Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal large language models lack domain-specific expertise to perform chemical tasks. |
| Approach: | They propose a benchmark dataset for evaluating multi-step multimodal reasoning capacities in the chemistry domain. |
| Outcome: | The proposed model surpasses existing models in all CheMM-Bench tasks. |
Enhancing Advanced Visual Reasoning Ability of Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models’ advanced reasoning ability. |
| Approach: | They propose a novel multi-modal in-context learning methodology to enhance LLMs’ contextual understanding and reasoning. |
| Outcome: | The proposed model achieves SOTA performance among all visual reasoning tasks and achieves a 'higher level of accuracy' than previous models. |
REAP: Towards Effective Training-Free Chemical Reasoning with Explicit Atomic Priors (2026.findings-acl)
Copied to clipboard
| Challenge: | Current approaches to instill explicit priors into LLMs often suffer from an information bottleneck . |
| Approach: | They propose a training-free framework that equips LLMs with an external knowledge base, enabling them to reason over retrieved chemical priors dynamically. |
| Outcome: | Experiments show that REAP outperforms current reasoning methods and rivals state-of-the-art training-based models. |
Evaluating Multi-Hop Reasoning in Large Language Models: A Chemistry-Centric Benchmark (2026.findings-eacl)
Copied to clipboard
Mohammad Khodadad, Ali Shiraee Kasmaee, Mahdi Astaraki, Nicholas Sherck, Hamidreza Mahyar, Soheila Samiee
| Challenge: | a new pipeline for compositional multi-hop reasoning in large language models is being developed . a recent study shows that even state-of-the-art models struggle with compositional reasoning . |
| Approach: | They propose a pipeline that builds benchmarks from proprietary or public data . they use generative reasoning models, chemical named-entity recognition, and external knowledge bases to build knowledge graphs. |
| Outcome: | The proposed pipeline compares state-of-the-art models with and without retrieval augmentation . the pipeline is generalizable with fine-tuning, enabling creation of challenging benchmarks . |
Seeing Beyond Words: MatVQA for Challenging Visual-Scientific Reasoning in Materials Science (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) outperform existing benchmarks in both natural language and coding domains. |
| Approach: | They propose a scalable benchmark that integrates vision and language modalities to address this gap by eliminating textual shortcuts. |
| Outcome: | The new benchmark outperforms existing benchmarks in both natural language and coding domains. |
Two Steps from Hell: Compositionality on Chemical LMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Experiments with state-of-the-art ChemLLMs show significant performance drops in compositional tasks, highlighting the need for models that move beyond pattern recognition. |
| Approach: | They introduce a benchmark to evaluate chemical language models' understanding of chemical language by identifying and analyzing compositional patterns within chemical data. |
| Outcome: | The proposed benchmark shows that existing LLMs can handle complex queries without pattern recognition. |
From Generalist to Specialist: A Survey of Large Language Models for Chemistry (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies on pretraining of LLMs on extensive web-based texts are insufficient for advanced scientific discovery, especially in chemistry. |
| Approach: | They outline methodologies for incorporating domain-specific chemistry knowledge and multi-modal information into LLMs and conceptualize chemistry LLM agents using chemistry tools. |
| Outcome: | The proposed models are based on domain-specific chemistry knowledge and multi-modal information and are capable of accelerating scientific research. |
MolErr2Fix: Benchmarking LLM Trustworthiness in Chemistry via Modular Error Detection, Localization, Explanation, and Correction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown growing potential in molecular sciences, but they often produce chemically inaccurate descriptions and struggle to recognize or justify potential errors. |
| Approach: | They propose a benchmark to assess LLMs on error detection and correction in molecular descriptions. |
| Outcome: | The proposed benchmark targets LLMs on error detection and correction in molecular descriptions. |
Making VLMs More Robot-Friendly: Self-Critical Distillation of Low-Level Procedural Reasoning (2025.emnlp-main)
Copied to clipboard
Chan Young Park, Jillian Fisher, Marius Memmel, Dipika Khullar, Seoho Yun, Abhishek Gupta, Yejin Choi
| Challenge: | Large language models (LLMs) are human-centric, but omit low-level, spatially grounded details needed for robotic execution. |
| Approach: | They propose a lightweight framework for vision-language procedural planning that enables iteratively critique, revise and verify their own plans without external supervision or teacher models. |
| Outcome: | a new framework outperforms weaker models 100X the size in vision-language procedural planning . the framework generates higher-quality, execution-ready plans that can be used at inference and fine-tuning . |
COCO-Tree: Compositional Hierarchical Concept Trees for Enhanced Reasoning in Vision-Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve compositional reasoning in vision language models are resource-intensive or do not provide an interpretable reasoning process. |
| Approach: | They propose a method that augments VLM outputs with carefully designed neurosymbolic concept trees learned from LLMs to improve VLM’s linguistic reasoning. |
| Outcome: | Empirical results show that COCO-Tree significantly improves compositional generalization and provides a rationale behind VLM predictions. |