| Challenge: | Existing domain adaptation algorithms for text classification are limited by lack of training data and exploiting domain idiosyncrasies to improve performance. |
| Approach: | They propose a domain adaptation layer that learns weights to combine a generic and a specific word embedding into a DA embeddable. |
| Outcome: | The proposed approach improves on binary and multi-class classification tasks using popular encoder architectures. |
Similar Papers
Domain Adapted Word Embeddings for Improved Sentiment Classification (P18-2)
Copied to clipboard
| Challenge: | Generic word embeddings are trained on large-scale generic corpora, while domain specific ones are trained only on data from a domain of interest. |
| Approach: | They propose a method to combine breadth of generic and specific embeddings to form domain-specific embeddables. |
| Outcome: | The proposed method outperforms generic and domain specific embeddings on sentiment classification tasks. |
Learning Word Embeddings for Data Sparse and Sentiment Rich Data Sets (N18-4)
Copied to clipboard
| Challenge: | Existing word embeddings for sentiment analysis are limited in domain specific applications . generic word embeds are poor initialization for tasks on domain specific data sets. |
| Approach: | They propose to use word embeddings adapted for domain specific data sets in sentiment classification applications. |
| Outcome: | The proposed algorithms learn word embeddings on sparse and sentiment rich data sets. |
Domain Adaptation for Sentiment Analysis Using Robust Internal Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Cross-domain sentiment analysis methods reduce the domain gap by training generalizable classifiers for each domain . large interclass margins in source domain help to reduce the effect of "domain shift" in the target domain. |
| Approach: | They propose a domain adaptation method which induces large margins between data representations that belong to different classes in an embedding space. |
| Outcome: | The proposed method reduces the domain gap by training cross-domain generalizable classifiers . large interclass margins in the source domain help reduce the effect of "domain shift" the proposed method is available in the u.s. |
Projecting Embeddings for Domain Adaption: Joint Modeling of Sentiment Analysis in Diverse Domains (C18-1)
Copied to clipboard
| Challenge: | Existing domain adaptation methods for sentiment analysis are sensitive to domain differences, resulting in classifiers that perform poorly on new domains. |
| Approach: | They propose a domain adaptation problem as an embedding projection task using two mono-domain embeddable spaces and a bi-domain space to project across domains and predict sentiment. |
| Outcome: | The proposed model performs better on domains similar to state-of-the-art methods while requiring longer training times. |
Task-oriented Domain-specific Meta-Embedding for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods neglect domain-specific knowledge and use the same word embedding for each word in all domain-specified datasets. |
| Approach: | They propose a method to incorporate domain-specific and task-oriented information into meta-embeddings by combining pre-trained word embeddings. |
| Outcome: | The proposed method performs well on four text classification datasets and shows that it is compatible with existing methods. |
Two Methods for Domain Adaptation of Bilingual Tasks: Delightfully Simple and Broadly Applicable (P18-1)
Copied to clipboard
| Challenge: | Previously, domain adaptation approaches to bilingual tasks were proposed . we show that simple adaptation process involving only unlabeled text is highly effective . |
| Approach: | They propose a method for domain adaptation of bilingual word embeddings using unlabeled data . they then tailor a semi-supervised classification method from computer vision to these tasks . |
| Outcome: | The proposed method improves on two bilingual tasks using unlabeled data. |
Learning Domain-Sensitive and Sentiment-Aware Word Embeddings (P18-1)
Copied to clipboard
| Challenge: | Existing word embeddings cannot produce domain-sensitive embeddables due to domain-specific nature of words. |
| Approach: | They propose a method for learning domain-sensitive and sentiment-aware embeddings that captures sentiment semantics and domain sensitivity of individual words. |
| Outcome: | The proposed method can produce domain-common embeddings and domain-specific embedds. |
PERL: Pivot-based Domain Adaptation for Pre-trained Deep Contextualized Embedding Models (2020.tacl-1)
Copied to clipboard
| Challenge: | PERL is a representation learning model that uses labeled data from the source domain and unlabeled data not necessarily drawn from the target domain. |
| Approach: | They propose a model that extends contextualized word embedding models with pivot-based fine-tuning to address this bottleneck. |
| Outcome: | The proposed model outperforms strong baselines across 22 sentiment classification domain adaptation setups and improves in-domain model performance. |
Adaptive Semi-supervised Learning for Cross-domain Sentiment Classification (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-domain sentiment classification are difficult and costly . domain adaptation is difficult because data in source and target domains are drawn from different distributions. |
| Approach: | They propose a semi-supervised learning approach that minimizes the distance between source and target instances in embedded feature space. |
| Outcome: | The proposed approach can improve on baseline methods in various settings. |
Embedding Strategies for Specialized Domains: Application to Clinical Entity Recognition (P19-2)
Copied to clipboard
| Challenge: | Off-the-shelf word embeddings tend to perform poorly on texts from specialized domains such as clinical reports. |
| Approach: | They combine off-the-shelf contextual embeddings with static word2vec embedders trained on a small in-domain corpus built from task data to reach and sometimes outperform representations learned from a large corpus in the medical domain. |
| Outcome: | The proposed embedding strategies outperform representations learned from a large corpus in the medical domain. |