Papers by Chunchen Wei
DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing code benchmarks for large language models remain static, resulting in data contamination and unreliable evaluation results. |
| Approach: | They propose a dynamic, complexity-aware benchmark that overcomes the limitations of static datasets and provides a memorization-advantaged benchmark. |
| Outcome: | DynaCode generates 189 million unique nested code problems across 4 units of code complexity and 16 types of call graphs. |