Papers by Siqiao Huang
Surge: On the Potential of Large Language Models as General-Purpose Surrogate Code Executors (2025.emnlp-main)
Copied to clipboard
| Challenge: | Neural surrogate models are powerful tools in data mining, but are underexplored . large language models (LLMs) have demonstrated remarkable capabilities in code-related tasks . |
| Approach: | They propose a benchmarking framework to examine the feasibility of large language models . they examine scaling laws, data efficiency, and predictive accuracy of 21 open-source and proprietary LLMs . |
| Outcome: | The proposed benchmark examines 21 open-source and proprietary LLMs . it also examines scaling laws, data efficiency, and predictive accuracy . |