Papers by Rishikesh Jha
Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for supervised meta-learning require many training tasks to generalize . cloze-style objectives can be used to generate a large, rich, meta-training task distribution from unlabeled text. |
| Approach: | They propose a self-supervised approach to generate a large, rich, meta-learning task distribution from unlabeled text. |
| Outcome: | The proposed approach generates a large, rich, meta-learning task distribution from unlabeled text. |
Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks (2020.coling-main)
Copied to clipboard
| Challenge: | Pre-trained transformer models have shown great success in improving performance on downstream tasks, but fine-tuning on a new task still requires large amounts of labeled data. |
| Approach: | They propose a method which allows optimization-based meta-learning across tasks . they use transformers to train transformer models and find better generalizations . |
| Outcome: | The proposed method outperforms self-supervised training and pre-trained models on 17 NLP tasks. |