Papers by Carter Larsen

GenGO

Omakase Read Later

Search

Papers by Carter Larsen

Findings

2026.findings-acl

competition programming and
patch generation
reality
real-world software development
test generation
ill-defined problems
synthetically generating diverse software tasks
Test Generation
C++
OmniCode

2026

Multimodality

1 papers

OmniCode: A Benchmark for Evaluating Software Development Agents (2026.findings-acl)

Copied to clipboard

Atharv Sonwane, Eng-Shen Tu, Wei-Chung Lu, Claas Beger, Carter Larsen, Debjit Dhar, Simon Alford, Rachel Chen, Ronit Pattanayak, Tuan Anh Dang, Guohao Chen, Gloria Geng, Kevin Ellis, Saikat Dutta

Challenge:	popular coding benchmarks focus on narrowly scoped tasks such as competition programming and patch generation.
Approach:	They propose a software engineering benchmark that aims to provide a broader set of tasks beyond code or patch generation.
Outcome:	The proposed framework performs well on bug fixing for Python, test generation, code review fixing, and style fixing with popular agent frameworks such as SWE-Agent.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations