Papers by Taneesh Gupta
CARMO: Dynamic Criteria Generation for Context Aware Reward Modelling (2025.findings-acl)
Copied to clipboard
Taneesh Gupta, Shivam Shandilya, Xuchao Zhang, Rahul Madhavan, Supriyo Ghosh, Chetan Bansal, Huaxiu Yao, Saravan Rajmohan
| Challenge: | Reward modeling in large language models is susceptible to reward hacking . flawed reward signals often lead to outputs that optimize for spurious correlates . |
| Approach: | They propose a new approach that generates dynamic, context-relevant criteria to ground the reward model prior to producing reward scores. |
| Outcome: | The proposed approach generates dynamic, context-relevant criteria to ground the model prior to producing reward scores. |