Papers by Gloria Geng
OmniCode: A Benchmark for Evaluating Software Development Agents (2026.findings-acl)
Copied to clipboard
Atharv Sonwane, Eng-Shen Tu, Wei-Chung Lu, Claas Beger, Carter Larsen, Debjit Dhar, Simon Alford, Rachel Chen, Ronit Pattanayak, Tuan Anh Dang, Guohao Chen, Gloria Geng, Kevin Ellis, Saikat Dutta
| Challenge: | popular coding benchmarks focus on narrowly scoped tasks such as competition programming and patch generation. |
| Approach: | They propose a software engineering benchmark that aims to provide a broader set of tasks beyond code or patch generation. |
| Outcome: | The proposed framework performs well on bug fixing for Python, test generation, code review fixing, and style fixing with popular agent frameworks such as SWE-Agent. |
Retrospective Learning from Interactions (2025.acl-long)
Copied to clipboard
| Challenge: | Multi-turn interactions between large language models and users naturally include implicit feedback signals. |
| Approach: | They propose a method to learn from feedback signals in past interactions without annotations . they use a multimodal LLM to solve a reasoning task with a combinatorial solution space . |
| Outcome: | The proposed method improves task completion rate from 31% to 82% without annotations. |