Challenge: Existing large-scale (> 30 B) models are costly and collapse when downsized to small open-source models.
Approach: They propose a framework for distilling large, multi-agent coding systems into a single 7B model.
Outcome: The proposed framework doubles xCodeEval accuracy and reduces GPU memory and token generation time by 4 compared to a 32B model.

Similar Papers

MapCoder: Multi-Agent Code Generation for Competitive Problem Solving (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive proficiency in natural language processing, but performance in code generation tasks remains limited.
Approach: They propose a framework that emulates the full cycle of program synthesis as observed in humans.
Outcome: The proposed framework replicates the full cycle of program synthesis as observed in human developers.
PairCoder: Pair Programming-Inspired Two-Agent Collaboration for Code Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing multi agent frameworks for large language models are brittle on code generation tasks.
Approach: They propose a framework that brings pair programming to autonomous LLM collaboration.
Outcome: Using PairCoder, large language models achieve better results on code generation tasks and reduce token usage by 40% to 70% on eight representative backbones.
Enhancing Code Generation Performance of Smaller Models by Distilling the Reasoning Ability of LLMs (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made significant advances in code generation through the ‘Chain-of-Thought’ prompting technique.
Approach: They propose a framework which aims to transfer LLMs’ reasoning capabilities to smaller models through distillation.
Outcome: The proposed framework improves the smaller model's code generation performance by over 130% on the APPS benchmark.
CodeSim: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made significant strides in code generation and problem solving.
Approach: They propose a multi-agent code generation framework that integrates human-like perception to address the stages of program synthesis.
Outcome: The proposed framework achieves state-of-the-art (pass@1) results and shows potential for even greater enhancement when cascaded with external debuggers.
MAgICoRe: Multi-Agent, Iterative, Coarse-to-Fine Refinement for Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Excessive refinement can cause over-correction and reduce performance, authors say . they say MAgICoRe is a framework for multi-agent iteration for coarse-to-fine refinement .
Approach: They propose a framework for multi-agent iteration for coarse-to-fine refinement that reduces excessive refinement by categorizing problems as easy or hard.
Outcome: The proposed framework beats Self-Consistency by 3.4%, Best-of-k by 3.2%, and Self-Refine by 4.0% on Llama-3-8B and GPT- 3.5.
Towards Effective and Efficient Multi-Agent Language Model Systems: Foundations, Prospects, and Applications (2026.acl-tutorials)

Copied to clipboard

Challenge: Multi-agent systems powered by large language models still face challenges . tutorial focuses on three core components to build effective and efficient systems .
Approach: This tutorial introduces recent advances in building effective and efficient multi-agent LLM systems . it focuses on three core components: model distillation, dynamic routing, memory- and compute efficient serving .
Outcome: This tutorial introduces state-of-the-art techniques for building efficient and efficient multi-agent LLM systems . it covers coordination and communication among agents, crucial for collective performance .
COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis (2025.findings-naacl)

Copied to clipboard

Challenge: Existing code debugging benchmarks focus on the Code Repair stage of the code generation process.
Approach: They propose a framework to evaluate the debugging abilities of large language models by emulating the human debug process.
Outcome: The proposed framework outperforms human-curated and GPT-4-generated training data, enabling 7B-scale LLMs to achieve comparable debugging performance to GPT-3.5.
MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference (2026.findings-eacl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks.
Approach: They propose a framework that optimizes MAS prompts as a maximum a posteriori problem and then iteratively updates agent prompts.
Outcome: The proposed framework surpasses manual and automated benchmarks in multiple tasks and provides general guidelines for building more reliable and principled multi-agent systems in the future.
A Strategic Coordination Framework of Small LMs Matches Large LMs in Data Synthesis (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models suffer from high computational costs and environmental inefficiency . smaller LMs are more accessible and sustainable, but their individual capabilities often fall short . a collaborative framework for small LM combines specialized roles to iterative refinement and quality control .
Approach: They propose a framework that aggregates specialized roles across small LMs to iterative refinement and quality control typically achieved by a single large LM.
Outcome: The proposed framework aggregates specialized roles across small LMs to iterative refinement and quality control typically achieved by large LM.
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes (2023.findings-acl)

Copied to clipboard

Challenge: Deploying large language models (LLMs) is difficult because they are memory inefficient and compute-intensive for practical applications.
Approach: They propose a mechanism that fine tunes or distills small models that outperform LLMs . they use human labels to fine tune models or LLM-generated labels to train models .
Outcome: The proposed method outperforms LLMs by using fewer training examples compared to few-shot prompted models using substantially smaller model sizes.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations