Challenge: Existing methods rely on a fixed set of strategies to evolve, which requires manual design and is monolithic in form.
Approach: They propose a method that uses diverse and specific knowledge tags to achieve controlled evolution by injecting different combinations of tags into original instructions.
Outcome: The proposed method generates better evolved data than existing methods and is more diverse and challenging.

Similar Papers

Automatic Instruction Evolving for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Evol-Instruct is an end-to-end framework that evolves instruction datasets without human effort.
Approach: They propose an end-to-end framework that evolves instruction datasets without human effort by analyzing and analyzing evolutionary strategies for the given instruction data.
Outcome: The proposed method outperforms human-designed methods on various benchmarks including MT-Bench, AlpacaEval, GSM8K, and HumanEval.
Tag-Instruct: Controlled Instruction Complexity Enhancement through Structure-based Augmentation (2025.findings-acl)

Copied to clipboard

Challenge: High-quality instruction data is crucial for developing large language models (LLMs), yet existing approaches struggle to effectively control instruction complexity.
Approach: They propose a framework that compresses instructions into a compact tag space and enhances complexity through RL-guided tag expansion.
Outcome: The proposed framework outperforms existing methods in the evaluation of instruction complexity augmentation and semantic compression of text into a compact tag space.
Tree-of-Evolution: Tree-Structured Instruction Evolution for Code Generation in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Data synthesis is a key research area in large language models (LLMs).
Approach: They propose a framework that models code instruction synthesis process with a tree structure and optimization-driven evolution to alleviate constraints of unidirectional synthesis and randomness-driven generation.
Outcome: The proposed framework outperforms open-weight code LLMs on five widely-used benchmarks.
Instruction Fusion: Advancing Prompt Evolution through Hybridization (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning Large Language Models (LLMs) encounter performance limitations, impeding further enhancements in code generation tasks.
Approach: They propose to combine two distinct prompts through a hybridization process to enhance the evolution of training prompts for code LLMs.
Outcome: The proposed method significantly improves the performance of Code LLMs across five code generation benchmarks, namely HumanEval, HumanEva+, MBPP, mbap+ and MultiPL-E.
TaCIE: Enhancing Instruction Comprehension in Large Language Models through Task-Centred Instruction Evolution (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning Large Language Models (LLMs) encounter performance limitations, impeding further enhancements in code generation tasks.
Approach: They propose to combine two distinct prompts through a hybridization process to enhance the evolution of training prompts for code LLMs.
Outcome: The proposed method significantly improves the performance of Code LLMs across five code generation benchmarks.
AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation (2024.emnlp-main)

Copied to clipboard

Challenge: proprietary large language models (LLMs) have demonstrated impressive code generation performance.
Approach: They propose an adaptive module-based model that refines the direct response distillation process by modular decomposition and adaptive response evolution.
Outcome: The proposed framework outperforms baseline model and code generation methods on three popular benchmarks.
Optimizing Instruction Synthesis: Effective Exploration of Evolutionary Space with Tree Search (2024.findings-emnlp)

Copied to clipboard

Challenge: Extensive research has highlighted the quality of instruction data is essential for the success of this alignment.
Approach: They propose a framework for iteratively improving existing instruction data by using Monte Carlo tree search to find suitable prompts that align the language model to effectively learn multiple skills.
Outcome: The proposed framework improves the evaluation scores of seed instruction data, raising the average evaluation scores from 2.19 to 3.81.
Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correction (2022.acl-long)

Copied to clipboard

Challenge: Currently, machine translation (MT) is the mainstream approach for GEC.
Approach: They propose to ensemble Transformer-based encoders by majority votes on span-level edits . their best ensemble achieves a new SOTA result even without pre-training on synthetic datasets - "Troy-Blogs" and "Try-1BW".
Outcome: The proposed model achieves a new SOTA result even without pre-training on synthetic datasets.
EvoR: Evolving Retrieval for Code Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing pipelines for retrieval-augmented code generation (RACG) use static knowledge bases with a single source, limiting adaptation capabilities of Large Language Models (LLMs) Extensive experiments demonstrate that EVOR achieves two to four times of execution accuracy compared to other methods such as Reflexion.
Approach: They propose a retrieval-augmented code generation pipeline that employs the synchronous evolution of queries and diverse knowledge bases.
Outcome: The proposed pipeline achieves two to four times of execution accuracy compared to other methods.
InsBank: Evolving Instruction Subset for Ongoing Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent studies emphasize that quality and diversity of instruction data are more crucial than quantity, highlighting the need to select diverse, high-quality subsets to reduce training costs.
Approach: They propose to use a continuously updated repository to integrate the latest valuable instruction data with a progressive evolution framework to evolve InsBank over time.
Outcome: The proposed framework outperforms baselines in InsBank evolution and extracts budget-specific subsets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations