Extracting the Essence and Discarding the Dross: Enhancing Code Generation with Contrastive Execution Feedback (2025.coling-main)
Copied to clipboard
| Challenge: | erroneous code generation methods amalgamate feedback and correct code as target sentences . a new approach to code generation with feedback is needed to improve model performance . |
| Approach: | They propose a learning-based code generation model with execution feedback that integrates feedback and correct code as target sentences. |
| Outcome: | a new model with execution feedback shows improvements in generating accurate code and understanding error correction. |
Similar Papers
StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback (2024.acl-long)
Copied to clipboard
Shihan Dou, Yan Liu, Haoxiang Jia, Enyu Zhou, Limao Xiong, Junjie Shan, Caishuang Huang, Xiao Wang, Xiaoran Fan, Zhiheng Xi, Yuhao Zhou, Tao Ji, Rui Zheng, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Existing work integrates reinforcement learning with compiler feedback to enhance code generation quality but the long code generated by LLMs makes RL exploration ineffective. |
| Approach: | They propose a framework that integrates reinforcement learning and compiler feedback to enhance code generation quality. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches in corresponding benchmarks and integrates reinforcement learning with compiler feedback to improve code generation quality. |
ReflectionCoder: Learning from Reflection Sequence for Enhanced One-off Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to enhance code generation performance include integrating compiler feedback. |
| Approach: | They propose a method that integrates compiler feedback to improve one-off code generation performance. |
| Outcome: | The proposed method improves one-off code generation performance on three benchmarks and can be applied to other domains that focus on final results and require long reasoning paths. |
OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement (2024.findings-acl)
Copied to clipboard
| Challenge: | OpenCodeInterpreter-33B provides a high level of performance for code generation, executing, and iterative refinement. |
| Approach: | They propose a family of open-source code systems for generating, executing, and iteratively refining code. |
| Outcome: | The OpenCodeInterpreter-33B performs well on humanEval, MBPP, and EvalPlus benchmarks. |
Achieving Stronger Generation via Simple Contrastive Tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have witnessed remarkable progress in large language models (LLMs). |
| Approach: | They propose a framework for contrastive decoding to enhance instruction-tuned models. |
| Outcome: | The proposed framework improves model performance without additional data or computational resources. |
Fine-grained Contrastive Learning for Definition Generation (2022.aacl-main)
Copied to clipboard
| Challenge: | Recent pre-trained transformer-based definition generation models lack effective representation learning to contain full semantic components of the given word, leading to under-specific definitions. |
| Approach: | They propose a novel contrastive learning method that encourages the model to capture more detailed semantic representations from the definition sequence encoding. |
| Outcome: | The proposed method could generate more specific definitions compared with state-of-the-art models. |
ToolCoder: A Systematic Code-Empowered Tool Learning Framework for Large Language Models (2025.acl-long)
Copied to clipboard
Hanxing Ding, Shuchang Tao, Liang Pang, Zihao Wei, Jinyang Gao, Bolin Ding, Huawei Shen, Xueqi Cheng
| Challenge: | Existing approaches to tool learning rely on hand-crafted prompts and natural language reasoning, making multi-step planning difficult and lacking precise error diagnosis and reflection mechanisms. |
| Approach: | They propose a framework that reformulates tool learning as a code generation task. |
| Outcome: | The proposed framework achieves superior performance in task completion accuracy and execution reliability compared to existing approaches. |
CodeFort: Robust Training for Code Generation Models (2024.findings-emnlp)
Copied to clipboard
Yuhao Zhang, Shiqi Wang, Haifeng Qian, Zijian Wang, Mingyue Shang, Linbo Liu, Sanjay Krishna Gouda, Baishakhi Ray, Murali Krishna Ramanathan, Xiaofei Ma, Anoop Deoras
| Challenge: | Existing research efforts to improve code generation models are inadequate . code generation model performance is degraded under small perturbations . |
| Approach: | They propose a framework to improve the robustness of code generation models by generalizing code perturbations to enrich training data and enabling various robust training strategies. |
| Outcome: | The proposed framework increases pass rates and robustness drop rate against code-syntax perturbations. |
Turning the Tide: Repository-based Code Reflection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Code large language models (LLMs) enhance programming by understanding and generating code across languages. |
| Approach: | a new benchmark evaluates code understanding and generation in repositories using code large language models. |
| Outcome: | The proposed model improves code understanding and generation in repositories by evaluating 1,888 test cases across 6 programming languages. |
A Simple, Yet Effective Approach to Finding Biases in Code Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent work shows that large language models can generate code on par with humans . however, data-driven approaches may not be sufficient for acquiring reasoning skills . |
| Approach: | They propose a framework that automatically identifies subtle cues a code generation model might exploit . they propose an automated intervention mechanism reminiscent of adversarial testing . |
| Outcome: | The proposed framework can be used as a data transformation technique during fine-tuning, acting as reversal strategy. |
CodeT5+: Open Code Large Language Models for Code Understanding and Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing code LLMs adopt a specific architecture or rely on a unified encoder-decoder network for downstream tasks, lacking flexibility to operate in the optimal architecture for a particular task. |
| Approach: | They propose to initialize code LLMs with frozen off-the-shelf LLM and explore instruction-tuning to align with natural language instructions. |
| Outcome: | The proposed model outperforms open-source LLMs on 20 code-related benchmarks. |