Source-Free Unsupervised Domain Adaptation for Question Answering via Prompt-Assisted Self-learning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing SFDA methods focus on the adaptation phase, overlooking the impact of source domain training on model generalizability. |
| Approach: | They propose a source-free domain adaptation approach for Question Answering where a model trained on a domain is adapted to unlabeled target domains without additional source data. |
| Outcome: | The proposed model outperforms existing methods in managing domain gaps and demonstrating greater stability across target domains. |
Similar Papers
ProQA: Structural Prompt-based Pre-training for Unified Question Answering (2022.naacl-main)
Copied to clipboard
Wanjun Zhong, Yifan Gao, Ning Ding, Yujia Qin, Zhiyuan Liu, Ming Zhou, Jiahai Wang, Jian Yin, Nan Duan
| Challenge: | Existing QA research on question answering is focused on specific question types, knowledge domains, or reasoning skills. |
| Approach: | They propose a unified QA paradigm that solves various tasks through a single model. |
| Outcome: | The proposed model improves QA-centric ability on 11 QA benchmarks. |
Unsupervised Adaptation of Question Answering Systems via Generative Self-training (2020.emnlp-main)
Copied to clipboard
| Challenge: | Supervised self-training methods have transformed applied machine learning . however, adapting to target data has received little attention . |
| Approach: | They propose a method to generate synthetic QA pairs for unsupervised self adaptation . they use massive amounts of data to simulate self-supervised tasks . |
| Outcome: | The proposed method improves QA systems significantly by using less data and training computation than existing augmentation approaches. |
QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Question answering models often suffer from performance deterioration upon deployment . |
| Approach: | They propose a self-supervised framework called QADA for QA domain adaptation . they propose to augment training QA samples with hidden space augmentation . |
| Outcome: | The proposed framework improves on multiple target datasets over state-of-the-art methods. |
PADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen Domains (2022.tacl-1)
Copied to clipboard
| Challenge: | Domain Adaptation (DA) algorithms suffer degradation when applied to out-of-distribution examples. |
| Approach: | They propose an example-based autoregressive Prompt learning algorithm for on-the-fly Any-Domain Adaptation . the algorithm is trained to generate a unique prompt that maps the test example to a semantic space . |
| Outcome: | The proposed model outperforms baselines in 14 multi-source adaptation scenarios. |
Learning to Generalize for Cross-domain QA (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for QA are hampered by increased training costs . current methods suffer significant performance degradation when applied to out-of-domain examples. |
| Approach: | They propose a method that combines prompting methods and linear probing with fine-tuning strategy, which does not entail additional cost. |
| Outcome: | The proposed method outperforms state-of-the-art baselines with an average increase in F1 score of 4.5%-7.9%. |
Domain Adaptation for Question Answering via Question Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Question answering systems often experience performance deterioration upon user-generated questions. |
| Approach: | They propose a question classification framework to help QA domains adapt to different domains. |
| Outcome: | The proposed framework improves on state-of-the-art datasets against multiple datasets. |
Self-Prompting Large Language Models for Zero-Shot Open-Domain QA (2024.naacl-long)
Copied to clipboard
| Challenge: | Open-Domain Question Answering (ODQA) aims to answer questions without explicitly providing specific background documents. |
| Approach: | They propose a framework to explicitly utilize the massive knowledge encoded in LLM parameters and their strong instruction understanding abilities. |
| Outcome: | The proposed framework surpasses state-of-the-art methods on three widely-used ODQA datasets and achieves comparable performance with customized fine-tuned models on full training data. |
Open-Domain Question Answering (2020.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial provides a comprehensive overview of cutting-edge research in open-domain question answering (QA) |
| Approach: | tutorial provides a comprehensive overview of cutting-edge research in open-domain question answering . focus will shift to cutting- edge models proposed for open- domain QA . |
| Outcome: | The tutorial will cover cutting-edge research in open-domain question answering (QA) it will cover two-stage retriever-reader approaches, dense retriever and end-to-end training, and retriever free methods . |
Multi-Domain Multilingual Question Answering (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Question answering (QA) is one of the most challenging tasks in natural language processing. |
| Approach: | a tutorial examines the state-of-the-art approaches to multi-domain and multilingual QA . they introduce standard benchmarks and discuss out-of the-box training with open-domain QA systems . |
| Outcome: | This tutorial aims to bridge the gap between open-domain and multilingual QA. |
Back-Training excels Self-Training at Unsupervised Domain Adaptation of Question Generation and Passage Retrieval (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using self-training to train unsupervised domains can be expensive, resulting in poor generalization due to distributional shift. |
| Approach: | They propose to use unaligned data to train unsupervised domain adaptation models using cheap synthetically generated labeled data. |
| Outcome: | The proposed method significantly outperforms self-training on question generation and passage retrieval domains and on MLQuestions and PubMedQA. |