GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation (2025.findings-emnlp)
Copied to clipboard
Wen Ye, Zhaocheng Liu, Gui Yuwei, Tingyu Yuan, Yunyue Su, Bowen Fang, Chaoyang Zhao, Qiang Liu, Liang Wang
| Challenge: | Existing methods for text-to-image synthesis lack systematic error analysis and refinement strategies, resulting in limited reliability and effectiveness. |
| Approach: | They propose a plug-and-play multi-agent system called GenPilot that integrates error analysis, clustering-based adaptive exploration, fine-grained verification and a memory module for iterative optimization. |
| Outcome: | The proposed method improves text consistency and structural coherence on images with a plug-and-play system. |
Similar Papers
PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization (2025.emnlp-demos)
Copied to clipboard
| Challenge: | PromptSculptor automates the iterative prompt optimization process for Text-to-Image models . previous work focused on generating detailed, high-quality prompts based on user feedback . |
| Approach: | They propose a framework that decomposes a task into four specialized agents . they use Chain-of-Thought reasoning to transform a short, vague user prompt into a comprehensive, refined prompt. |
| Outcome: | The proposed framework significantly improves output quality and reduces iterations needed for user satisfaction. |
SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Text-to-Video (T2V) generation is a challenge under complex scenarios. |
| Approach: | They propose a scenario-aware and self-correcting multi-agent prompt refinement framework for T2V prompting. |
| Outcome: | The proposed framework improves text-to-video alignment and overall generation quality under complex scenarios. |
Prompt Refinement with Image Pivot for Text-to-Image Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in text-to-image generation have markedly expanded the boundaries of digital artistry, enabling the creation of visually compelling images with unprecedented ease. |
| Approach: | They propose to decompose the prompt refinement process into two tasks: inferring user-preferred images from user languages and translating them into system languages. |
| Outcome: | Experiments show that PRIP outperforms baselines and transfers to unseen systems in a zero-shot manner. |
Generative Prompt Internalization (2025.naacl-long)
Copied to clipboard
| Challenge: | Prompts used in large language model based applications are often fixed and lengthy, leading to significant computational overhead. |
| Approach: | They propose a method that internalizes complex prompts using a joint training approach and a data synthesis technique that auto-collects conversational datasets by swapping roles of agent and environment. |
| Outcome: | The proposed method internalizes complex prompts across agent-based applications and generates the content along with reasons for why it should change accordingly. |
Prompt Expansion for Adaptive Text-to-Image Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Text-to-image generation models are powerful but difficult to use. Users craft specific prompts to get better images, though the prompts can be repetitive. |
| Approach: | They propose a framework that takes a text query as input and outputs a set of expanded text prompts that are optimized to generate a wider variety of appealing images. |
| Outcome: | The proposed framework generates high-quality images from text prompts with less effort and is more aesthetically pleasing than baseline models. |
PromptSuite: A Task-Agnostic Framework for Multi-Prompt Generation (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that LLMs are highly sensitive to small, meaning-preserving variations in task formulation. |
| Approach: | They propose a framework that enables the automatic generation of various prompts. |
| Outcome: | The proposed framework provides meaningful variations to support strong evaluation practices. |
BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesis (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Recent text-to-image models require multiple passes of prompt engineering by humans to produce satisfactory results for real-world applications. |
| Approach: | They propose a deep generative model to generate high-quality prompts from raw descriptions using visual feedback. |
| Outcome: | The proposed model produces high-quality prompts from simple raw descriptions . it can be integrated to a cloud-native AI platform to provide better image generation service in the cloud. |
ZERA: Zero-init Instruction Evolving Refinement Agent – From Zero Instructions to Structured Prompts via Principle-based Optimization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve large language model performance focus on user prompts and require large sample sizes and long iteration cycles. |
| Approach: | They propose a framework that jointly optimizes both system and user prompts . they evaluate ZERA across five LLMs and nine diverse datasets spanning reasoning, summarization, and code generation tasks. |
| Outcome: | The proposed framework improves prompt construction over baselines and is available on github . it scores prompts using eight generalizable criteria and revises prompts based on structured critiques. |
MapCoder: Multi-Agent Code Generation for Competitive Problem Solving (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive proficiency in natural language processing, but performance in code generation tasks remains limited. |
| Approach: | They propose a framework that emulates the full cycle of program synthesis as observed in humans. |
| Outcome: | The proposed framework replicates the full cycle of program synthesis as observed in human developers. |
PAFT: Prompt-Agnostic Fine-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prompt-agnostic fine-tuning (PAFT) improves performance by reducing overfitting to specific prompts. |
| Approach: | They propose a method that enhances robustness through dynamic prompt variation during training. |
| Outcome: | The proposed method achieves higher generalization accuracy on unseen prompts than standard methods with similar training efficiency. |