IoTMigrator: LLM-driven Embedded IoT Code Migration across Different OSes for Cloud-device Integration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Neither outline-based code generation nor common code translation techniques can adequately address this challenge, despite their prevalence in existing systems. |
| Approach: | They have developed an algorithm that employs a multi-agent pipeline to handle embedded code migration under the TSL paradigm. |
| Outcome: | The proposed algorithm outperforms the baseline by 50.5% for pass rate and 13.0% for completeness across all tasks in RIOT and Zephyr. |
Similar Papers
CODEMENV: Benchmarking Large Language Models on Code Migration (2025.findings-acl)
Copied to clipboard
Keyuan Cheng, Xudong Shen, Yihao Yang, TengyueWang TengyueWang, Yang Cao, Muhammad Asif Ali, Hanbin Wang, Lijie Hu, Di Wang
| Challenge: | Large language models (LLMs) have demonstrated remarkable proficiency in handling a wide range of tasks within the software engineering domain, but their ability to perform code migration—adapting code to different environments—remains underexplored. |
| Approach: | They propose a benchmark to evaluate large language models’ performance in handling code migration tasks. |
| Outcome: | The proposed benchmark comprises 922 data points across 19 Python and Java packages and offers three tasks to systematically evaluate code migration: identifying version-incompatible functions, determining function changes, and adapting code to target environments. |
DeepRTL2: A Versatile Model for RTL-Related Tasks (2025.findings-acl)
Copied to clipboard
| Challenge: | Integration of large language models into electronic design automation has been a key driver in eDA. |
| Approach: | They propose a family of large language models that unifies generation- and embedding-based tasks related to RTL. |
| Outcome: | The proposed model achieves state-of-the-art performance across all evaluated tasks. |
LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | LLMOps pipelines are used to migrate knowledge and abilities from service-oriented LLMs to smaller, locally manageable models. |
| Approach: | They propose an LLMOps pipeline for the seamless migration of knowledge and abilities from service-oriented LLMs to smaller, locally manageable models. |
| Outcome: | Experiments with leading-edge LLMs show that the proposed pipeline can scale to meet various tasks and domains. |
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories (2024.findings-acl)
Copied to clipboard
Jia Li, Ge Li, Yunfei Zhao, Yongmin Li, Huanyu Liu, Hao Zhu, Lecheng Wang, Kaibo Liu, Zheng Fang, Lanshen Wang, Jiazheng Ding, Xuanming Zhang, Yuqi Zhu, Yihong Dong, Zhi Jin, Binhua Li, Fei Huang, Yongbin Li, Bin Gu, Mengfei Yang
| Challenge: | Existing benchmarks are poorly aligned with real-world code repositories and are insufficient to evaluate the coding abilities of Large Language Models (LLMs). |
| Approach: | They propose a repository-level benchmark named DevEval to evaluate LLMs' coding abilities in real-world code repositories. |
| Outcome: | The proposed benchmarks show that the LLMs perform better in real-world code repositories than existing benchmarks. |
CodeArena: Evaluating and Aligning CodeLLMs on Human Preference (2025.emnlp-main)
Copied to clipboard
Jian Yang, Jiaxi Yang, Wei Zhang, Jin Ke, Yibo Miao, Lei Zhang, Liqun Yang, Zeyu Cui, Yichang Zhang, Zhoujun Li, Binyuan Hui, Junyang Lin
| Challenge: | Code large language models (codeLLMs) focus on synthesizing the correct code snippet, ignoring the alignment with human preferences. |
| Approach: | They propose a benchmark code-based on 40 categories and 44 programming languages to emulate real-world coding tasks. |
| Outcome: | The proposed benchmarks show that open-source code LLMs perform better than open-sourced ones. |
CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Tasks (2026.acl-long)
Copied to clipboard
Lingyue Fu, Hao Guan, Bolun Zhang, Haowei Yuan, Yaoming Zhu, Lin Qiu, ZongYu Wang, Xuezhi Cao, Xunliang Cai, Weiwen Liu, Weinan Zhang, Yong Yu
| Challenge: | Existing large language models for software engineering rely on coarse-grained pass rates obscuring specific cognitive bottlenecks. |
| Approach: | They propose a repository-level benchmark that dissects coding capabilities through atomized tasks. |
| Outcome: | The proposed framework achieves a 78.55% validity yield, surpassing the 31.7% retention rate of SWE-bench-Verified. |
MIGRATE: Cross-Lingual Adaptation of Domain-Specific LLMs through Code-Switching and Embedding Transfer (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have advanced in many fields, but focus on English-centric models requires extensive data. |
| Approach: | They propose a method that leverages open-source static embedding models and up to 3 million tokens of code-switching data to facilitate the seamless transfer of embeddables to target languages. |
| Outcome: | The proposed method outperforms baseline and existing cross-lingual transfer methods in target languages. |
Octopus: On-device language model for function calling of software APIs (2025.naacl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are pivotal for advanced text processing and generation. |
| Approach: | They propose a framework to train on-device Large Language Models optimized for invoking software APIs. |
| Outcome: | The proposed model outperforms GPT-4 in API calling tasks while maintaining inference speed. |
The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have emerged as the new recommendation engines, surpassing traditional methods in both capability and scope, particularly in code generation. |
| Approach: | They propose to use a dataset to investigate a new type of bias in Large Language Models for code generation, provider bias, to determine whether the model favors specific providers. |
| Outcome: | The proposed model favors services from Google and Amazon, but without explicit directives, and can modify input code to incorporate their preferred providers without user requests. |
Guaranteed Guess: A Language Modeling Approach for CISC-to-RISC Transpilation with Testing Guarantees (2025.findings-emnlp)
Copied to clipboard
| Challenge: | ISA-centric transpilation pipelines are used to translate low-level programs between ISAs . GG provides high code coverage across unit tests and better energy efficiency . |
| Approach: | They propose a ISA-centric transpilation pipeline that embeds large language models into software testing frameworks to ensure accuracy. |
| Outcome: | The proposed method achieves high code coverage across unit tests and functional/semantic correctness of 99% on HumanEval and 49% on BringupBench programs. |