Rewriting the Code: A Simple Method for Large Language Model Augmented Code Search (2024.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that ReCo significantly boosts retrieval accuracy across sparse, zero-shot dense and fine-tuned dense search settings. |
| Approach: | They propose a generation-augmented retrieval framework that additionally Rewrites the Code (ReCo) within the codebase for style normalization. |
| Outcome: | The proposed method significantly boosts retrieval accuracy across sparse, zero-shot dense, and fine-tuned dense retrieval settings in diverse search scenarios. |
Similar Papers
Improving Repository-level Code Search with Text Conversion (2024.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods to search for related files based on similarity between code snippets are not effective for repository-level code generation. |
| Approach: | They propose to take similarities between code snippets and the texts converted from them into LLMs to search for related files and perform generation. |
| Outcome: | The proposed method improves the accuracy of code search on the repository level. |
CodeRAG-Bench: Can Retrieval Augment Code Generation? (2025.findings-naacl)
Copied to clipboard
Zora Zhiruo Wang, Akari Asai, Xinyan Velocity Yu, Frank F. Xu, Yiqing Xie, Graham Neubig, Daniel Fried
| Challenge: | Language models excel at generating code, but many programs are difficult to generate using only parametric knowledge. |
| Approach: | They propose a retrieval-augmented code generation benchmark that provides reproducible evaluations on retrieval and end-to-end code generation performance. |
| Outcome: | The proposed benchmark covers programming, open-domain, and repository-level tasks and provides reproducible evaluations on retrieval and end-to-end code generation performance. |
ReACC: A Retrieval-Augmented Code Completion Framework (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work has shown that statistical language modeling with transformers can greatly improve the performance in code completion tasks. |
| Approach: | They propose a retrieval-augmented code completion framework that combines a source code retriever and an auto-regressive language model for programming language. |
| Outcome: | The proposed framework achieves state-of-the-art on CodeXGLUE benchmark. |
Exploring Representation-level Augmentation for Code Search (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent data augmentations for code search are at the raw-data level, which requires additional code analysis and training cost. |
| Approach: | They propose a general format of representation-level augmentation that unifies existing methods. |
| Outcome: | The proposed methods can boost the performance of code search models on a large-scale dataset. |
code-transformed: The Influence of Large Language Models on Code (2026.findings-eacl)
Copied to clipboard
| Challenge: | Using Large Language Models, code generation capabilities have transformed programming practices. |
| Approach: | They analyze 20,000 GitHub repositories linked to arXiv papers published between 2020 and 2025 . they identify measurable trends in the evolution of coding style that align with LLM-generated code . |
| Outcome: | The proposed study examines 20,000 GitHub repositories linked to arXiv papers . it finds that LLMs influence code style, and that they can be observed in real-world code . |
Query Rewriting in Retrieval-Augmented Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on adapting either the retriever or the reader, but this approach is more focused on adaptation of the query itself. |
| Approach: | They propose a new framework for retrieval-augmented Large Language Models . they propose rewrite-retrieve-read instead of retrieve-then-read . |
| Outcome: | The proposed framework improves performance on downstream tasks, open-domain QA and multiple-choice QA. |
SACL: Understanding and Combating Textual Bias in Code Retrieval with Semantic-Augmented Reranking and Localization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that code retrievers exhibit a strong bias towards well-documented code . |
| Approach: | They propose a framework that augments textual information with semantic information to mask specific features while preserving code functionality. |
| Outcome: | The proposed framework enhances textual information and reduces bias by augmenting code or structural knowledge with semantic information. |
OASIS: Order-Augmented Strategy for Improved Code Search (2025.acl-long)
Copied to clipboard
Gao Zuchen, Zizheng Zhan, Xianming Li, Erxin Yu, Haotian Zhang, Chenbin Chenbin, Yuqun Zhang, Jing Li
| Challenge: | Code embeddings capture the semantic representations of code and are crucial for various code-related large language model (LLM) applications. |
| Approach: | They propose an order-augmented strategy for improved code search that leverages order-based similarity labels to capture subtle differences in similarity among negative pairs. |
| Outcome: | The proposed model outperforms state-of-the-art models focusing on major positive-negative differences. |
Optimizing Code Retrieval: High-Quality and Scalable Dataset Annotation through Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for code retrieval struggle to balance scalability and annotation quality. |
| Approach: | They propose a method that integrates functions called within the repository and information on third-party APIs to enhance the annotation context. |
| Outcome: | The proposed method improves the annotation context by incorporating functions called within the repository and information on third-party API functionalities. |
Across Programming Language Silos: A Study on Cross-Lingual Retrieval-Augmented Code Generation (2026.findings-acl)
Copied to clipboard
Qiming Zhu, Jialun Cao, Xuanang Chen, Weili Zhang, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Shing-Chi Cheung
| Challenge: | Current research on large language models with retrieval-augmented code generation (RACG) has focused on single-language settings, leaving their cross-lingual effectiveness underexplored. |
| Approach: | They construct a dataset covering 13 PLs with nearly 14K instances to study cross-lingual code knowledge transfer in RACG. |
| Outcome: | The proposed model shows unequal cross-lingual knowledge transfer even with direct injection and shows limited reliance on natural language information embedded in code when equipped with a code-specific retriever. |