| Challenge: | Existing models for sentiment analysis and hate speech detection are difficult to account for domain shift without access to source data. |
| Approach: | They propose to treat domain adaptation as a modular process that involves separate model producers and model consumers . they demonstrate that they can independently cooperate to facilitate more accurate measurements of text . |
| Outcome: | The proposed methods improve out-of-domain accuracy on four multi-domain text classification datasets. |
Similar Papers
Projecting Embeddings for Domain Adaption: Joint Modeling of Sentiment Analysis in Diverse Domains (C18-1)
Copied to clipboard
| Challenge: | Existing domain adaptation methods for sentiment analysis are sensitive to domain differences, resulting in classifiers that perform poorly on new domains. |
| Approach: | They propose a domain adaptation problem as an embedding projection task using two mono-domain embeddable spaces and a bi-domain space to project across domains and predict sentiment. |
| Outcome: | The proposed model performs better on domains similar to state-of-the-art methods while requiring longer training times. |
What’s in a Domain? Learning Domain-Robust Text Representations using Adversarial Training (N18-2)
Copied to clipboard
| Challenge: | a key roadblock is application to new domains, unseen in training. |
| Approach: | They propose a method to optimise in- and out-of-domain accuracy by combing domain-specific and domain-general components with adversarial training for domain. |
| Outcome: | The proposed method improves on domain adaptation and domain-adversarial training. |
Domain Adaptation for Sentiment Analysis Using Robust Internal Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Cross-domain sentiment analysis methods reduce the domain gap by training generalizable classifiers for each domain . large interclass margins in source domain help to reduce the effect of "domain shift" in the target domain. |
| Approach: | They propose a domain adaptation method which induces large margins between data representations that belong to different classes in an embedding space. |
| Outcome: | The proposed method reduces the domain gap by training cross-domain generalizable classifiers . large interclass margins in the source domain help reduce the effect of "domain shift" the proposed method is available in the u.s. |
Weighed Domain-Invariant Representation Learning for Cross-domain Sentiment Analysis (2020.coling-main)
Copied to clipboard
| Challenge: | Cross-domain sentiment analysis is a hot topic in research and industry . domain-invariant representation learning (DIRL) is used to learn a feature representation across domains . but, when label distribution P(Y) shifts across domain, it degrades performance . |
| Approach: | They propose a domain-invariant representation learning framework to improve cross-domain sentiment analysis performance. |
| Outcome: | The proposed model is easy to transfer existing models to the proposed model. |
The Trade-offs of Domain Adaptation for Neural Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Neural Language Models (LMs) trained on large generic training sets have been shown to be effective at adapting to smaller, specific target domains for language modeling and other downstream tasks. |
| Approach: | They propose a framework for a Neural Language Models (LM) to be presented in a common framework. |
| Outcome: | The proposed framework highlights similarities and subtle differences between adaptation techniques and the framework. |
Semi-supervised Domain Adaptation for Dependency Parsing via Improved Contextualized Word Representations (2020.coling-main)
Copied to clipboard
| Challenge: | Recent advances in deep neural network models have improved parsing performance on in-domain texts . however, the problem is to improve performance on out-of-domain text data when there is only a small-scale out-domain labeled data. |
| Approach: | They propose to use adversarial learning and fine-tuning BERT to improve contextualized word representations on out-of-domain texts. |
| Outcome: | The proposed models achieve consistent improvement and fine-tune BERT processes boost parsing accuracy by a large margin. |
CDAˆ2: Counterfactual Diffusion Augmentation for Cross-Domain Adaptation in Low-Resource Sentiment Analysis (2025.coling-main)
Copied to clipboard
| Challenge: | Domain adaptation is widely employed in cross-domain sentiment analysis, but concerns have been raised regarding their robustness and sensitivity to data distribution shift. |
| Approach: | They propose a framework CDA2 for cross-domain adaptation in low-resource sentiment analysis which employs counterfactual diffusion augmentation. |
| Outcome: | The proposed framework generates high-quality counterfactual target samples and achieves state-of-the-art performance on benchmark datasets. |
Adapting Bias Evaluation to Domain Contexts using Generative Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to assess social bias in NLP systems face limitations in scalability and fidelity across domains. |
| Approach: | They propose a domain-adaptive framework that uses prompting with Large Language Models to automatically transform template-based bias datasets into domain-specific variants. |
| Outcome: | The proposed framework improves the accuracy and contextual relevance of bias evaluations in socially relevant datasets. |
Margin-aware Unsupervised Domain Adaptation for Cross-lingual Text Labeling (2020.findings-emnlp)
Copied to clipboard
Dejiao Zhang, Ramesh Nallapati, Henghui Zhu, Feng Nan, Cicero Nogueira dos Santos, Kathleen McKeown, Bing Xiang
| Challenge: | Existing approaches to learn a model from labeled data are expensive or prohibitive. |
| Approach: | They propose an unsupervised domain adaptation algorithm that leverages labeled data in a source domain to learn a well-performing model in . they use the Margin Disparity Discrepancy algorithm to optimize the margin loss on the source domain. |
| Outcome: | The proposed approach improves on a recent theoretical work on cross-lingual document classification and NER by a large margin. |
Semi-supervised Domain Adaptation for Dependency Parsing (P19-1)
Copied to clipboard
| Challenge: | Currently, most studies on cross-domain parsing focus on unsupervised domain adaptation . however, unsupervised approaches make limited progress due to the intrinsic difficulty of both domain adaptation and parse. |
| Approach: | They propose a semi-supervised domain adaptation problem for Chinese dependency parsing by using newly-annotated large-scale domain-aware datasets. |
| Outcome: | The proposed method is more effective than direct corpus concatenation and multi-task learning. |