Papers by Zhanke Zhou
SATBench: Benchmarking LLMs’ Logical Reasoning via Automated Puzzle Generation from SAT Formulas (2025.emnlp-main)
Copied to clipboard
Anjiang Wei, Yuheng Wu, Yingjia Wan, Tarun Suresh, Huanmi Tan, Zhanke Zhou, Sanmi Koyejo, Ke Wang, Alex Aiken
| Challenge: | SATBench is a benchmark for evaluating the logical reasoning capabilities of large language models (LLMs) through logical puzzles derived from Boolean satisfiability (SAT) problems. |
| Approach: | They propose a benchmark to evaluate logical reasoning capabilities of large language models (LLMs) using logical puzzles derived from Boolean satisfiability problems. |
| Outcome: | The proposed model achieves 65.0% accuracy on hard UNSAT problems, close to the baseline of 50%. |
Efficient Hyper-parameter Search for Knowledge Graph Embedding (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for learning knowledge graphs do not search hyper-parameters efficiently. |
| Approach: | They propose an efficient two-stage search algorithm which explores HP configurations on small subgraph and transfers top-performed configurations for fine-tuning on large full graph. |
| Outcome: | The proposed method finds better HPs than baseline algorithms within the same time budget and achieves 9.1% relative improvement on large-scale knowledge graphs. |
Physics Reasoner: Knowledge-Augmented Reasoning for Solving Physics Problems with Large Language Models (2025.coling-main)
Copied to clipboard
Xinyu Pang, Ruixin Hong, Zhanke Zhou, Fangrui Lv, Xinwei Yang, Zhilong Liang, Bo Han, Changshui Zhang
| Challenge: | Existing large language models (LLMs) fail due to lack of knowledge or incorrect knowledge application. |
| Approach: | They propose a knowledge-augmented framework that constructs a formula set to provide explicit physics knowledge and utilizes checklists to guide effective knowledge application. |
| Outcome: | The proposed framework achieves state-of-the-art performance on SciBench with an average accuracy improvement of 5.8%. |