Robust Prompt Optimization for Large Language Models Against Distribution Shifts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing research has explored automatic prompt optimization methods to eliminate manual effort in identifying effective prompts for a given task. |
| Approach: | They propose a framework for prompt optimization that can be generalized to an unlabeled target group. |
| Outcome: | The proposed framework improves on target group and source group while generalizing to unlabeled target group. |
Similar Papers
DLPO: Towards a Robust, Efficient, and Generalizable Prompt Optimization Framework from a Deep-Learning Perspective (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for prompt optimization still face challenges in robustness, efficiency, and generalization. |
| Approach: | They propose 7 new approaches inspired by traditional deep learning paradigms for prompt optimization that integrate text-based gradient optimization. |
| Outcome: | The proposed methods integrate deep learning paradigms into text-based gradient optimization. |
Measuring Distribution Shift in User Prompts and Its Effects on LLM Performance (2026.acl-long)
Copied to clipboard
| Challenge: | a large-scale evaluation of deployed LLMs under natural prompt distribution shift is needed . natural prompt behavior shifts can cause performance degradation in dynamic, real-world settings . |
| Approach: | They propose a data-centric framework for measuring natural prompt distribution shift . they train models on 4.68M training prompts and evaluate on 57.6k prompts . |
| Outcome: | The proposed framework evaluates natural prompt distribution shift in LLMs over time and between user groups. |
When Punctuation Matters: A Large-Scale Comparison of Prompt Robustness Methods for LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are sensitive to subtle, non-semantic variations in prompt phrasing and formatting. |
| Approach: | They propose to evaluate 4 methods for improving prompt robustness within a unified experimental framework. |
| Outcome: | The proposed methods are compared to 8 models from Llama, Qwen and Gemma families and are generalized against multiple types of distribution shifts. |
MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization (2023.findings-emnlp)
Copied to clipboard
Yuyan Chen, Zhihao Wen, Ge Fan, Zhengyu Chen, Wei Wu, Dayiheng Liu, Zhixu Li, Bang Liu, Yanghua Xiao
| Challenge: | Existing research emphasizes the importance of adapting prompts to specific tasks, rather than specific LLMs. |
| Approach: | They propose a model-adaptive prompt optimizer method that optimizes original prompts for each LLM in downstream tasks. |
| Outcome: | The proposed method can optimize prompts for an LLM in downstream tasks. |
Enhancing LLM-as-a-Judge through Active-Sampling-based Prompt Optimization (2025.acl-industry)
Copied to clipboard
| Challenge: | Suboptimal prompts can introduce biases, inconsistencies, and unreliable evaluations. |
| Approach: | They propose an active-sampling-based framework for automatic prompt optimization . they use a small, diverse subset of samples to guide prompt refinement . |
| Outcome: | The proposed framework outperforms baselines on four popular LLMs and three real-world datasets. |
Direct Prompt Optimization with Continuous Representations (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for prompt optimization for language models lack extensibility and search space. |
| Approach: | They propose a method that integrates greedy strategies into optimization with continuous representations to address instability caused by rounding. |
| Outcome: | The proposed approach can improve prompt optimization performance on text classification and attack tasks, as well as models, including GPT-2, OPT, Vicuna, and LLaMA-2. |
Distribution Prompting: Understanding the Expressivity of Language Models Through the Next-Token Distributions They Can Produce (2025.emnlp-main)
Copied to clipboard
| Challenge: | Autoregressive neural language models (LMs) generate a probability distribution over tokens at each time step given a prompt. |
| Approach: | They propose to find a prompt that induces LMs to output a distribution as close as possible to the target, using either soft or hard gradient-based prompt tuning. |
| Outcome: | The proposed model is able to generate a distribution as close as possible to a target given a prompt, and it can be used to approximate distributions with low or high entropy. |
Beyond Prompt Engineering: A Systematic Analysis of Prompt Lexical Sensitivity and Its Impacts on Quality (2026.findings-acl)
Copied to clipboard
Qipeng Xie, Zi Liang, Jiafei Wu, Yufei Chen, Weizheng Wang, Wenao Ma, Zhong Ming, Haiqin Yang, Kaishun Wu
| Challenge: | Existing studies on prompt engineering have focused on optimizing models for performance under stylistic perturbations. |
| Approach: | They conduct the first analysis of n-gram token-level mechanisms . they find that higher average performance is inherently associated with lower variance and greater stability. |
| Outcome: | The proposed model reduces the variance of the generated code by 40% . the proposed model is based on a large-scale dataset of 132,000 prompt variants . |
Mixture of Soft Prompts for Controllable Data Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) generate fluent text when the target output follows natural language patterns. |
| Approach: | They propose a method that uses large language models to generate fluent text from a limited ontology rather than direct prediction by using soft prompts. |
| Outcome: | The proposed method produces diverse and natural text while preserving label semantics. |
Demystifying optimized prompts in language models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Modern language models (LMs) are not robust to out-of-distribution inputs. |
| Approach: | They investigate the composition of machine generated (“optimized”) prompts and the mechanisms by which LMs parse and build predictions from them. |
| Outcome: | The proposed prompts are primarily composed of punctuation and noun tokens, which are more rare in the training data. |