Papers by Yuwei An
PBEBench: A Multi-Step Programming by Examples Reasoning Benchmark inspired by Historical Linguistics (2026.findings-acl)
Copied to clipboard
Atharva Naik, null Prakam, Yash Mathur, Darsh Agrawal, Manav Nitin Kapadnis, Yuwei An, Clayton Marr, Carolyn Rose, David R. Mortensen
| Challenge: | a benchmark for inductive reasoning is based on sound law induction in historical linguistics . solve rates are below 5% on hard PBEBench instances with long program cascades despite expensive scaling strategies . |
| Approach: | They propose a benchmark for inductive reasoning inspired by sound law induction in historical linguistics. |
| Outcome: | The proposed approach generates problems with controllable difficulty and ordering constraints . solve rates remain below 5% on hard PBEBench instances with long program cascades . |