Papers by Naman Jain
The Counterfeit Conundrum: Can Code Language Models Grasp the Nuances of Their Incorrect Generations? (2024.findings-acl)
Copied to clipboard
| Challenge: | Language models are more proficient at code generation, but they still generate incorrect programs. |
| Approach: | They define a group of models that have a high log-probability and weak correctness checks. |
| Outcome: | The proposed model samples fail to understand counterfeits through three clear failure modes . counterfeits are confusing to the model as they are to other models, the authors say . |