Papers by Apoorv Bhatia
ReproEvalCard: A Reporting Standard for Reproducible Evaluation of LLM Pipelines (2026.acl-short)
Copied to clipboard
| Challenge: | Existing evaluation standards for multistage pipelines are inconsistent, leaving the reproducibility and independent validation of published evaluations unclear. |
| Approach: | They propose a lightweight reporting standard that specifies the minimum artifacts required to reproduce and validate LLM evaluations. |
| Outcome: | The proposed standard audits 55 pipeline-based LLM papers published between 2022 and 2025 and quantifies the availability of reproducibility-critical evaluation artifacts. |