Papers with in-task
Efficiently Tuned Parameters Are Task Embeddings (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for intermediate-task transfer are computationally infeasible to experiment with all intermediate combinations. |
| Approach: | They propose to use task-specific parameters updated in parameter-efficient tuning methods to predict inter-task transferability. |
| Outcome: | The proposed approach outperforms existing methods while being conceptually simple and computationally efficient. |
Large Language Models are Miscalibrated In-Context Learners (2025.findings-acl)
Copied to clipboard
| Challenge: | In-context Learning and Supervised Fine-Tuning have emerged as pre-dominant methodologies for machine learning and NLP. |
| Approach: | They propose to use self-ensembling to improve both performance and calibration of language models. |
| Outcome: | The proposed learning paradigms can achieve better calibration and better performance than the previous learning paradigm. |
On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Visually-rich document entity retrieval (VDER) is an important topic in industrial NLP applications. |
| Approach: | They propose a task-aware meta-learning framework to tackle the problem of visually-rich document entity retrieval (VDER) they adopt a hierarchical decoder and employ contrastive learning to achieve this goal. |
| Outcome: | The proposed framework significantly improves the robustness of popular meta-learning baselines. |