Papers by Aum Wadhwani
REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for reproducing social science papers focus on reproducing results using provided code and data without assessing their consistency with the paper. |
| Approach: | They propose a benchmark to evaluate agentic AI systems' ability to automate reproducibility assessment. |
| Outcome: | The proposed benchmark oversimplifies real-world scenarios and lacks diversity in data formats and programming languages. |