Papers by Vedant Gaur
The Progress Illusion: Revisiting meta-evaluation standards of LLM evaluators (2025.findings-emnlp)
Copied to clipboard
| Challenge: | LLM judges have gained popularity as an inexpensive and performant substitute for human evaluation. |
| Approach: | They revisit meta-evaluations of LLM evaluators under a setting that more closely aligns with practice by examining evaluers’ ability to distinguish test system pairs that are closer in capability. |
| Outcome: | The proposed meta-evaluation setting is significantly different from the use of human evaluations. |
Reasoning in Large Language Models Through Symbolic Math Word Problems (2023.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized NLP by solving downstream tasks with little to no labeled data. |
| Approach: | They propose a model that uses symbolic expressions to provide a concise explanation of the numeric answer. |
| Outcome: | The proposed model has good accuracy on symbolic word problems and is able to provide a concise and verifiable reasoning and make it more interpretable. |