Papers by Jun-cheng Chen
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt Tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Prompt Tuning has been a popular fine-tuning method for large-scale pretrained language models. |
| Approach: | They propose a method that allows all soft prompts to share a set of learnable codebook vectors in each subspace, with each prompt differentiated by a number of adaptive weights. |
| Outcome: | The proposed method achieves superior performance on 17 diverse natural language tasks including natural language understanding (NLU) and question answering (QA) tasks by tuning only 0.3% of parameters of the PLMs. |