Unsupervised Domain Adaptation for Event Detection using Domain-specific Adapters (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to ED are limited due to complexity of textual data and domain shift problem. |
| Approach: | They propose to use domain adapter-based Adaptation framework to improve event detection across domains. |
| Outcome: | The proposed framework significantly boosts the performance on target domains. |
Similar Papers
Towards Open Domain Event Trigger Identification using Adversarial Domain Adaptation (2020.acl-main)
Copied to clipboard
| Challenge: | supervised event trigger identification models can generalize better across domains . prior work focused on annotating specific categories of events or narratives from specific domains. |
| Approach: | They propose to use adversarial domain adaptation framework to build supervised event trigger identification models which can generalize better across domains. |
| Outcome: | The proposed model improves on literature and news domains with no labeled data. |
UDAPTER - Efficient Domain Adaptation Using Adapters (2023.eacl-main)
Copied to clipboard
| Challenge: | Using adapters, unsupervised domain adaptation (UDA) is more parameter efficient and requires large-scale data to be effective. |
| Approach: | They propose to add small bottleneck layers to each layer of a pre-trained language model to make it more parameter efficient by adding adapters. |
| Outcome: | The proposed methods outperform unsupervised domain adaptation methods such as DANN and DSN in natural language inference and sentiment classification tasks. |
Domain Adaptation with BERT-based Domain Classification and Data Selection (D19-61)
Copied to clipboard
| Challenge: | Modern deep neural models with millions of parameters can easily adapt to a new learning task and dataset when enough supervision is given. |
| Approach: | They propose a domain adaptation framework based on curriculum learning and domain-discriminative data selection. |
| Outcome: | The proposed framework outperforms discrepancy-based methods on transfer tasks while consuming only fraction of training budget. |
Unsupervised Domain Adaptation for Joint Information Extraction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Current JIE methods focus on standard supervised learning setting where training and test data come from the same domain. |
| Approach: | They propose a method to induce domain-invariant representations for the tasks in JIE by a generalized version of domain-adversarial learning. |
| Outcome: | The proposed method improves out-of-domain performance for current pipeline approaches for all IE tasks. |
Adapt in Contexts: Retrieval-Augmented Domain Adaptation via In-Context Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models have demonstrated their capability with few-shot inference . however, in-domain demonstrations are not always available in real scenarios . |
| Approach: | They propose unsupervised domain adaptation problem to adapt language models from source domain to target domain without any target labels. |
| Outcome: | The proposed model performs better than baseline models on Sentiment Analysis and Named Entity Recognition tasks. |
Semi-supervised Domain Adaptation for Dependency Parsing via Improved Contextualized Word Representations (2020.coling-main)
Copied to clipboard
| Challenge: | Recent advances in deep neural network models have improved parsing performance on in-domain texts . however, the problem is to improve performance on out-of-domain text data when there is only a small-scale out-domain labeled data. |
| Approach: | They propose to use adversarial learning and fine-tuning BERT to improve contextualized word representations on out-of-domain texts. |
| Outcome: | The proposed models achieve consistent improvement and fine-tune BERT processes boost parsing accuracy by a large margin. |
Adversarial and Domain-Aware BERT for Cross-Domain Sentiment Analysis (2020.acl-main)
Copied to clipboard
| Challenge: | Cross-domain sentiment classification requires large amounts of labeled data. |
| Approach: | They propose to apply a pre-training language model BERT on unsupervised domain adaptation . they propose to distill domain-specific features in a self-supervised way . |
| Outcome: | The proposed model outperforms state-of-the-art methods on Amazon dataset . it can be applied to the unsupervised domain adaptation task without domain awareness . |
Domain Classification-based Source-specific Term Penalization for Domain Adaptation in Hate-speech Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches for hate-speech detection exhibit poor performance in out-of-domain settings due to overemphasizing source-specific information that negatively impacts its domain invariance. |
| Approach: | They propose a domain adaptation approach that automatically extracts and penalizes source-specific terms using a classifier. |
| Outcome: | The proposed approach improves cross-domain evaluation on indomain held-out instances while preserving high performance on out-of-domain settings. |
Domain Differential Adaptation for Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Neural networks are data hungry and domain sensitive, so it is difficult to obtain labeled data for every domain. |
| Approach: | They propose a framework for domain adaptation where we model the difference between domains instead of smoothing over them. |
| Outcome: | The proposed framework improves on domain adaptation in multiple experimental settings. |
Adapting Event Extractors to Medical Data: Bridging the Covariate Shift (2021.eacl-main)
Copied to clipboard
| Challenge: | a new study examines the performance of event extractors to new domains without labeled data . event extraction is a key sub-task of interest for text understanding pipelines in multiple domains . |
| Approach: | They propose to align marginal distributions of source and target domains to adapt event extractors to new domains . they use clinical notes and doctor-patient conversations as a testbed . |
| Outcome: | The proposed models reach F1 scores of 70.0 and 72.9 on notes and conversations respectively. |