PAFT: Prompt-Agnostic Fine-Tuning (2025.emnlp-main)

Copied to clipboard

Challenge: Prompt-agnostic fine-tuning (PAFT) improves performance by reducing overfitting to specific prompts.
Approach: They propose a method that enhances robustness through dynamic prompt variation during training.
Outcome: The proposed method achieves higher generalization accuracy on unseen prompts than standard methods with similar training efficiency.

Similar Papers

The Power of Scale for Parameter-Efficient Prompt Tuning (2021.emnlp-main)

Copied to clipboard

Challenge: Unlike discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signals from any number of labeled examples.
Approach: They propose a mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks.
Outcome: The proposed method outperforms fewshot learning using GPT-3 and matches the quality of model tuning as models exceed billions of parameters.
SMoP: Towards Efficient and Effective Prompt Tuning with Sparse Mixture-of-Prompts (2023.emnlp-main)

Copied to clipboard

Challenge: Prompt tuning has emerged as a successful parameter-efficient alternative to the full fine-tuning of language models.
Approach: They propose a prompt tuning method that utilizes short soft prompts for efficient training and inference while maintaining performance gains typically induced by longer soft prompt.
Outcome: The proposed method outperforms baseline methods while preserving memory usage.
The Power of Prompt Tuning for Low-Resource Semantic Parsing (2022.acl-short)

Copied to clipboard

Challenge: Prompt tuning is an effective method for adapting pre-trained language models to downstream tasks.
Approach: They propose to use prompt tuning for semantic parsing to map natural language utterances onto formal meaning representations.
Outcome: The proposed method outperforms the fine-tuned model on low-resource splits of Overnight and TOPv2 on language representations with increasing model scale and target representations.
P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks (2022.acl-short)

Copied to clipboard

Challenge: Existing methods of prompt tuning cannot handle hard sequence labeling tasks.
Approach: They propose to optimize prompt tuning to tune continuous prompts with a frozen language model.
Outcome: The proposed method matches finetuning with prompt tuning while having only 0.1%-3% tuned parameters.
KaFT: Knowledge-aware Fine-tuning for Boosting LLMs’ Domain-specific Question-Answering Performance (2025.findings-acl)

Copied to clipboard

Challenge: Recent literature reveals that supervised fine-tuning (SFT) is suboptimal for domain-specific question-answering tasks.
Approach: They propose a query diversification strategy for robust conflict detection and a knowledge-aware fine-tuning approach to effectively boost LLMs’ performance.
Outcome: The proposed approach improves the model generalization and alleviates the hallucination.
PEFT-Bench: A Parameter-Efficient Fine-Tuning Methods Benchmark (2026.eacl-long)

Copied to clipboard

Challenge: Parameter-Efficient Fine-Tuning (PEFT) methods reduce the number of trainable parameters while maintaining strong downstream performance.
Approach: They propose a unified benchmark for evaluating diverse PEFT methods on autoregressive LLMs.
Outcome: The proposed methods reduce trainable parameters while maintaining strong downstream performance.
FPT: Improving Prompt Tuning Efficiency via Progressive Training (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent prompt tuning (PT) has gained increasing attention as a parameter-efficient way of tuning pre-trained language models (PLMs).
Approach: They propose a prompt tuning algorithm that uses a small-scale partial PLM and progressively expands its depth and width until the full-model size.
Outcome: The proposed method could save over 30% of training computations while achieving comparable performance.
promptolution: A Unified, Modular Framework for Prompt Optimization (2026.eacl-demo)

Copied to clipboard

Challenge: Existing implementations of prompt optimization are tied to unmaintained, isolated codebases or require invasive integration into application frameworks.
Approach: They propose a unified, modular open-source framework that integrates multiple contemporary discrete prompt optimizers within a single extensible system for both practitioners and researchers.
Outcome: The proposed framework integrates multiple discrete prompt optimizers, supports systematic and reproducible benchmarking, and returns framework-agnostic prompt strings, enabling seamless integration into existing LLM pipelines while remaining agnosite to the underlying model implementation.
Compatibility-Aware Dynamic Fine-Tuning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Recent work attributes optimization instability to the low probability of demonstrations being incompatible with the sample level.
Approach: They propose a Dynamic Fine-Tuning extension of DFT that controls sample-level optimization variance.
Outcome: The proposed model can generalize token-level stabilization to the sample level while remaining fully supervised and free of reward modeling.
Prompt Compression for Large Language Models: A Survey (2025.naacl-long)

Copied to clipboard

Challenge: Current methods for improving LLM efficiency focus on optimizing the model itself, while prompt-centric methods focus on lowering the complexity of input.
Approach: They propose to use prompt compression to optimize the compression encoder and combine hard and soft prompt methods to improve the efficiency of LLMs.
Outcome: The proposed methods are categorized into hard prompt methods and soft prompt methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations