Papers by Kaixuan Ji
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Prompt tuning is a technique that updates few parameters in pre-trained models for language understanding and generation tasks. |
| Approach: | They propose to leverage prompt tuning for neural text retrieval to improve generalization and cross-domain generalization. |
| Outcome: | The proposed approach can mitigate the two issues faced by fine-tuning retrieval methods and improve the out-of-domain zero-shot generalization of the retrieval models. |
P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks (2022.acl-short)
Copied to clipboard
| Challenge: | Existing methods of prompt tuning cannot handle hard sequence labeling tasks. |
| Approach: | They propose to optimize prompt tuning to tune continuous prompts with a frozen language model. |
| Outcome: | The proposed method matches finetuning with prompt tuning while having only 0.1%-3% tuned parameters. |