Papers by Jinwei Zhang
ChemReason-Bench: Benchmarking Large Language Models for Procedural Reasoning in Experimental Chemistry (2026.acl-long)
Copied to clipboard
| Challenge: | Experimental protocols in organic synthesis specify not only the intended transformation, but also an executable sequence of operations and conditions. |
| Approach: | They propose a human-validated benchmark for verifiable experimental procedure reasoning . they instantiate 7306 benchmark tasks across six complementary formats . |
| Outcome: | The proposed benchmarks show that the evaluations are less diagnostic of procedure-level decision making. |
MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in NoSQL database support focus on English . however, the intricacy and heterogeneity of NoSqL query languages present a formidable challenge . |
| Approach: | They propose a multilingual benchmark for natural language to NoSQL query generation that covers six languages. |
| Outcome: | The proposed framework improves performance in English and non-English settings, while ignoring lexical and syntactic differences. |
Coarse-to-Fine Grounded Memory for LLM Agent Planning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to enhance LLM with offline experiences or online trajectory analysis focus on single-granularity memory derived from dynamic environmental interactions. |
| Approach: | They propose a framework that grounds coarse-to-fine memories with LLM to enable flexible adaptation to diverse scenarios. |
| Outcome: | Extensive experiments on AlfWorld, Webshop and ScienceWorld show that the proposed framework outperforms baselines and comprehensively optimizes memory-enhanced LLM Agent system. |