Papers by Soheila Samiee
Evaluating Multi-Hop Reasoning in Large Language Models: A Chemistry-Centric Benchmark (2026.findings-eacl)
Copied to clipboard
Mohammad Khodadad, Ali Shiraee Kasmaee, Mahdi Astaraki, Nicholas Sherck, Hamidreza Mahyar, Soheila Samiee
| Challenge: | a new pipeline for compositional multi-hop reasoning in large language models is being developed . a recent study shows that even state-of-the-art models struggle with compositional reasoning . |
| Approach: | They propose a pipeline that builds benchmarks from proprietary or public data . they use generative reasoning models, chemical named-entity recognition, and external knowledge bases to build knowledge graphs. |
| Outcome: | The proposed pipeline compares state-of-the-art models with and without retrieval augmentation . the pipeline is generalizable with fine-tuning, enabling creation of challenging benchmarks . |