Papers by Soohan Lim
ContractEval: A Benchmark for Evaluating Contract-Satisfying Assertions in Code Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Current evaluations measure functional correctness on well-formed inputs, but they filter out inputs that violate them. |
| Approach: | They propose a benchmark to evaluate whether generated code enforces preconditions . they use a neuro-symbolic pipeline to evaluate code with test cases . |
| Outcome: | The proposed benchmark aims to evaluate whether generated code enforces preconditions . it aims at achieving pass@k scores while ignoring those that violate them . |
TCProF:Time-Complexity Prediction SSL Framework (2025.naacl-long)
Copied to clipboard
| Challenge: | determining the precise time complexity of a code is theoretically undecidable . determining time complexity is a challenging task in programming efficiency analysis . |
| Approach: | They propose a time-complexity prediction SSL framework that uses code snippets labeled with their time complexity classes to predict code time. |
| Outcome: | The proposed approach improves performance by 60% over self-training methods. |