Papers by Mansi Uniyal
One-to-many testing for code generation from (just) natural language (2024.findings-emnlp)
Copied to clipboard
| Challenge: | MBPP relies on test cases to generate the right signature, data contamination is a problem . adapted code generation benchmarks allow for the description to be underspecified with respect to syntactic properties of code. |
| Approach: | They propose a code generation benchmark that allows for the description to be underspecified with respect to syntactic properties of code. |
| Outcome: | The proposed model removes ambiguity about the semantics of the task from the descriptions and evaluates generated code on multiple sets of assertions to account for ambiguities in the syntax. |
Agentic Context Strategies for Multi-Format Document Understanding: When Should Language Models Use Tools? (2026.acl-industry)
Copied to clipboard
| Challenge: | Large language models face fundamental trade-offs when processing long documents . full context is expensive and may exceed limits, while RAG risks missing relevant information. |
| Approach: | They evaluate four context strategies across three document formats to evaluate their results . they find agentic tool-augmented approaches outperform passive strategies . |
| Outcome: | The agentic tool-augmented approaches outperform passive strategies on three document formats. |