QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Question answering models often suffer from performance deterioration upon deployment . |
| Approach: | They propose a self-supervised framework called QADA for QA domain adaptation . they propose to augment training QA samples with hidden space augmentation . |
| Outcome: | The proposed framework improves on multiple target datasets over state-of-the-art methods. |
Similar Papers
Domain Adaptation for Question Answering via Question Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Question answering systems often experience performance deterioration upon user-generated questions. |
| Approach: | They propose a question classification framework to help QA domains adapt to different domains. |
| Outcome: | The proposed framework improves on state-of-the-art datasets against multiple datasets. |
Contrastive Domain Adaptation for Question Answering using Limited Text Corpora (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing question generation methods rely on large amounts of synthetically generated datasets and costly computational resources. |
| Approach: | They propose a framework for domain adaptation that combines question generation and domain-invariant learning to answer out-of-domain questions in settings with limited text corpora. |
| Outcome: | The proposed framework improves on state-of-the-art questions in a domain with limited text corpora. |
Source-Free Unsupervised Domain Adaptation for Question Answering via Prompt-Assisted Self-learning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing SFDA methods focus on the adaptation phase, overlooking the impact of source domain training on model generalizability. |
| Approach: | They propose a source-free domain adaptation approach for Question Answering where a model trained on a domain is adapted to unlabeled target domains without additional source data. |
| Outcome: | The proposed model outperforms existing methods in managing domain gaps and demonstrating greater stability across target domains. |
Unsupervised Domain Adaptation for Question Generation with DomainData Selection and Self-training (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing question generation models require large-scale and high-quality training data. |
| Approach: | They propose an unsupervised domain adaptation approach to combat the lack of training data and domain shift issue with domain data selection and self-training. |
| Outcome: | The proposed approach outperforms baselines on three large datasets with different domain similarities, using a transformer-based pre-trained QG model. |
Unsupervised Adaptation of Question Answering Systems via Generative Self-training (2020.emnlp-main)
Copied to clipboard
| Challenge: | Supervised self-training methods have transformed applied machine learning . however, adapting to target data has received little attention . |
| Approach: | They propose a method to generate synthetic QA pairs for unsupervised self adaptation . they use massive amounts of data to simulate self-supervised tasks . |
| Outcome: | The proposed method improves QA systems significantly by using less data and training computation than existing augmentation approaches. |
Domain Adaptation for Subjective Induction Questions Answering on Products by Adversarial Disentangled Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to answer subjective questions about products are often imbalanced across product domains. |
| Approach: | They propose a domain-adaptive model that integrates multiple viewpoints into a good answer by integrating these heterogeneous and inconsistent viewpoints. |
| Outcome: | The proposed model integrates multiple viewpoints into a single answer span and is able to integrate them into the answer. |
Learning to Generalize for Cross-domain QA (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for QA are hampered by increased training costs . current methods suffer significant performance degradation when applied to out-of-domain examples. |
| Approach: | They propose a method that combines prompting methods and linear probing with fine-tuning strategy, which does not entail additional cost. |
| Outcome: | The proposed method outperforms state-of-the-art baselines with an average increase in F1 score of 4.5%-7.9%. |
Long Context Question Answering via Supervised Contrastive Learning (2022.naacl-main)
Copied to clipboard
| Challenge: | Long-context question answering tasks often require identifying evidence spans (e.g., sentences) prior work showed that jointly training models to perform evidence extraction and question answering is important for achieving high performance. |
| Approach: | They propose a method for equipping long-context QA models with an additional sequence-level objective for better identification of the supporting evidence. |
| Outcome: | The proposed method exhibits consistent improvements on three different strong long-context transformer models, across two challenging question answering benchmarks – HotpotQA and QAsper. |
Synthetic Question Value Estimation for Domain Adaptation of Question Answering (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work adapts QA scores to select high-quality questions, but these scores do not improve QA performance on the target domain. |
| Approach: | They propose to synthesize QA pairs with a question generator on the target domain . they propose to train a Question Value Estimator that estimates usefulness of synthetic questions . |
| Outcome: | The proposed method improves the performance of the target domain QA model by using synthetic questions and only 15% of the human annotations on the targetdomain. |
Multi-Domain Multilingual Question Answering (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Question answering (QA) is one of the most challenging tasks in natural language processing. |
| Approach: | a tutorial examines the state-of-the-art approaches to multi-domain and multilingual QA . they introduce standard benchmarks and discuss out-of the-box training with open-domain QA systems . |
| Outcome: | This tutorial aims to bridge the gap between open-domain and multilingual QA. |