Papers by Hanwei Xu
GPS: Genetic Prompt Search for Efficient Few-Shot Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models are often finetuned for downstream tasks, which has been shown to improve performance over non-pretrained models. |
| Approach: | They propose a genetic algorithm to automatically search for the best prompt for few-shot learning with pretrained language models by gradient-free algorithm. |
| Outcome: | Experiments on diverse datasets show that the proposed method outperforms manual prompts by 2.6 points. |
ZeroPrompt: Scaling Prompt-Based Pretraining to 1,000 Tasks Improves Zero-Shot Generalization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that task scaling can be an efficient alternative to model scaling. |
| Approach: | They propose a multitask pretraining approach ZeroPrompt for zero-shot generalization . they focus on task scaling and zero-shooting to improve model performance . |
| Outcome: | The proposed approach improves zero-shot generalization efficiency by 30 times with task scaling. |