Papers with o1
InductionBench: LLMs Fail in the Simplest Complexity Class (2025.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks focus on deductive reasoning, largely overlooking inductive reasoning. |
| Approach: | They propose a benchmark to evaluate the inductive reasoning ability of large language models. |
| Outcome: | The proposed benchmark demonstrates that even the most advanced modelw struggle to master the simplest complexity classes within the subregular hierarchy of functions. |