Papers by Micah Helzerman
How Hard is Math? Using Quantitative Metrics to Measure LLM Alignment to Human Intuitions of Difficulty (2026.acl-srw)
Copied to clipboard
| Challenge: | Often overlooked is how "difficulty" is operationalized in the context of LLM problem solving tasks. |
| Approach: | They examine quantitative measurements from LLM-generated solutions and evaluate their inter-correlations with human-annotated difficulty scores. |
| Outcome: | The proposed model shows that LLMs can solve problems with reasonable accuracy, but performance is poor when generalizing to other benchmarks. |