Papers by Alex Duchnowski
A Knapsack by Any Other Name: Presentation impacts LLM performance on NP-hard problems (2025.findings-emnlp)
Copied to clipboard
| Challenge: | EHOP is a collection of NP-hard optimization problems expressed in natural language . state-of-the-art LLMs solve textbook problems more accurately than their real-life counterparts, but they lack a truly robust reasoning mechanism. |
| Approach: | They introduce a dataset of everyday hard optimization problems (EHOP) which includes problem formulations found in computer science textbooks, versions dressed up as problems that could arise in real life, and variants with inverted rules. |
| Outcome: | The proposed dataset includes problem formulations found in computer science textbooks, versions dressed up as problems that could arise in real life, and variants with inverted rules. |