Tag-Evol: Achieving Efficient Instruction Evolving via Tag Injection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods rely on a fixed set of strategies to evolve, which requires manual design and is monolithic in form. |
| Approach: | They propose a method that uses diverse and specific knowledge tags to achieve controlled evolution by injecting different combinations of tags into original instructions. |
| Outcome: | The proposed method generates better evolved data than existing methods and is more diverse and challenging. |
Similar Papers
Automatic Instruction Evolving for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Evol-Instruct is an end-to-end framework that evolves instruction datasets without human effort. |
| Approach: | They propose an end-to-end framework that evolves instruction datasets without human effort by analyzing and analyzing evolutionary strategies for the given instruction data. |
| Outcome: | The proposed method outperforms human-designed methods on various benchmarks including MT-Bench, AlpacaEval, GSM8K, and HumanEval. |
Tag-Instruct: Controlled Instruction Complexity Enhancement through Structure-based Augmentation (2025.findings-acl)
Copied to clipboard
| Challenge: | High-quality instruction data is crucial for developing large language models (LLMs), yet existing approaches struggle to effectively control instruction complexity. |
| Approach: | They propose a framework that compresses instructions into a compact tag space and enhances complexity through RL-guided tag expansion. |
| Outcome: | The proposed framework outperforms existing methods in the evaluation of instruction complexity augmentation and semantic compression of text into a compact tag space. |
Tree-of-Evolution: Tree-Structured Instruction Evolution for Code Generation in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Data synthesis is a key research area in large language models (LLMs). |
| Approach: | They propose a framework that models code instruction synthesis process with a tree structure and optimization-driven evolution to alleviate constraints of unidirectional synthesis and randomness-driven generation. |
| Outcome: | The proposed framework outperforms open-weight code LLMs on five widely-used benchmarks. |
Instruction Fusion: Advancing Prompt Evolution through Hybridization (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models (LLMs) encounter performance limitations, impeding further enhancements in code generation tasks. |
| Approach: | They propose to combine two distinct prompts through a hybridization process to enhance the evolution of training prompts for code LLMs. |
| Outcome: | The proposed method significantly improves the performance of Code LLMs across five code generation benchmarks, namely HumanEval, HumanEva+, MBPP, mbap+ and MultiPL-E. |
TaCIE: Enhancing Instruction Comprehension in Large Language Models through Task-Centred Instruction Evolution (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models (LLMs) encounter performance limitations, impeding further enhancements in code generation tasks. |
| Approach: | They propose to combine two distinct prompts through a hybridization process to enhance the evolution of training prompts for code LLMs. |
| Outcome: | The proposed method significantly improves the performance of Code LLMs across five code generation benchmarks. |
AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | proprietary large language models (LLMs) have demonstrated impressive code generation performance. |
| Approach: | They propose an adaptive module-based model that refines the direct response distillation process by modular decomposition and adaptive response evolution. |
| Outcome: | The proposed framework outperforms baseline model and code generation methods on three popular benchmarks. |
Optimizing Instruction Synthesis: Effective Exploration of Evolutionary Space with Tree Search (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Extensive research has highlighted the quality of instruction data is essential for the success of this alignment. |
| Approach: | They propose a framework for iteratively improving existing instruction data by using Monte Carlo tree search to find suitable prompts that align the language model to effectively learn multiple skills. |
| Outcome: | The proposed framework improves the evaluation scores of seed instruction data, raising the average evaluation scores from 2.19 to 3.81. |
Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correction (2022.acl-long)
Copied to clipboard
| Challenge: | Currently, machine translation (MT) is the mainstream approach for GEC. |
| Approach: | They propose to ensemble Transformer-based encoders by majority votes on span-level edits . their best ensemble achieves a new SOTA result even without pre-training on synthetic datasets - "Troy-Blogs" and "Try-1BW". |
| Outcome: | The proposed model achieves a new SOTA result even without pre-training on synthetic datasets. |
EvoR: Evolving Retrieval for Code Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing pipelines for retrieval-augmented code generation (RACG) use static knowledge bases with a single source, limiting adaptation capabilities of Large Language Models (LLMs) Extensive experiments demonstrate that EVOR achieves two to four times of execution accuracy compared to other methods such as Reflexion. |
| Approach: | They propose a retrieval-augmented code generation pipeline that employs the synchronous evolution of queries and diverse knowledge bases. |
| Outcome: | The proposed pipeline achieves two to four times of execution accuracy compared to other methods. |
InsBank: Evolving Instruction Subset for Ongoing Alignment (2025.findings-emnlp)
Copied to clipboard
Jiayi Shi, Yiwei Li, Shaoxiong Feng, Peiwen Yuan, Xinglin Wang, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Huan Ren, Yao Hu, Kan Li
| Challenge: | Recent studies emphasize that quality and diversity of instruction data are more crucial than quantity, highlighting the need to select diverse, high-quality subsets to reduce training costs. |
| Approach: | They propose to use a continuously updated repository to integrate the latest valuable instruction data with a progressive evolution framework to evolve InsBank over time. |
| Outcome: | The proposed framework outperforms baselines in InsBank evolution and extracts budget-specific subsets. |