Two Methods for Domain Adaptation of Bilingual Tasks: Delightfully Simple and Broadly Applicable (P18-1)
Copied to clipboard
| Challenge: | Previously, domain adaptation approaches to bilingual tasks were proposed . we show that simple adaptation process involving only unlabeled text is highly effective . |
| Approach: | They propose a method for domain adaptation of bilingual word embeddings using unlabeled data . they then tailor a semi-supervised classification method from computer vision to these tasks . |
| Outcome: | The proposed method improves on two bilingual tasks using unlabeled data. |
Similar Papers
Evaluating bilingual word embeddings on the long tail (N18-2)
Copied to clipboard
| Challenge: | Bilingual word embeddings are useful for bilingual lexicon induction, but they focus on frequent words in general domains. |
| Approach: | They propose to evaluate bilingual word embeddings on rare words in different domains . they propose to use a multilingual dataset to build and combine BWEs based on a single word . |
| Outcome: | The proposed evaluations show that state-of-the-art methods fail on rare words . the proposed evaluation is based on a gold standard dataset and code . |
Language adaptation experiments via cross-lingual embeddings for related languages (L18-1)
Copied to clipboard
| Challenge: | Language Adaptation is a general approach to extend existing resources from a better resourced language to a lesser resourced one. |
| Approach: | They propose to exploit lexical and grammatical similarity between languages when they are related by using orthographic similarity. |
| Outcome: | The proposed method improves the state of the art in induction of bilingual lexicons . it also improves induction performance in the Named-Entity Recognition task . |
Projecting Embeddings for Domain Adaption: Joint Modeling of Sentiment Analysis in Diverse Domains (C18-1)
Copied to clipboard
| Challenge: | Existing domain adaptation methods for sentiment analysis are sensitive to domain differences, resulting in classifiers that perform poorly on new domains. |
| Approach: | They propose a domain adaptation problem as an embedding projection task using two mono-domain embeddable spaces and a bi-domain space to project across domains and predict sentiment. |
| Outcome: | The proposed model performs better on domains similar to state-of-the-art methods while requiring longer training times. |
Shallow Domain Adaptive Embeddings for Sentiment Analysis (D19-1)
Copied to clipboard
| Challenge: | Existing domain adaptation algorithms for text classification are limited by lack of training data and exploiting domain idiosyncrasies to improve performance. |
| Approach: | They propose a domain adaptation layer that learns weights to combine a generic and a specific word embedding into a DA embeddable. |
| Outcome: | The proposed approach improves on binary and multi-class classification tasks using popular encoder architectures. |
Leveraging Meta-Embeddings for Bilingual Lexicon Extraction from Specialized Comparable Corpora (C18-1)
Copied to clipboard
| Challenge: | Recent studies on bilingual lexicon extraction from specialized comparable corpora show differences in performance . lack of large specialized corporan to build efficient representations can be partially explained . |
| Approach: | They propose to use character-based embedding models to combine different embeddable models . they emphasize how character-driven embeddance models outperform other models on quality . |
| Outcome: | The proposed model outperforms other models on quality of extracted bilingual lexicons . comparable corpora are an interesting and practical alternative to parallel corporation . |
Semi-supervised Domain Adaptation for Dependency Parsing (P19-1)
Copied to clipboard
| Challenge: | Currently, most studies on cross-domain parsing focus on unsupervised domain adaptation . however, unsupervised approaches make limited progress due to the intrinsic difficulty of both domain adaptation and parse. |
| Approach: | They propose a semi-supervised domain adaptation problem for Chinese dependency parsing by using newly-annotated large-scale domain-aware datasets. |
| Outcome: | The proposed method is more effective than direct corpus concatenation and multi-task learning. |
Adaptive Semi-supervised Learning for Cross-domain Sentiment Classification (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-domain sentiment classification are difficult and costly . domain adaptation is difficult because data in source and target domains are drawn from different distributions. |
| Approach: | They propose a semi-supervised learning approach that minimizes the distance between source and target instances in embedded feature space. |
| Outcome: | The proposed approach can improve on baseline methods in various settings. |
Domain Adapted Word Embeddings for Improved Sentiment Classification (P18-2)
Copied to clipboard
| Challenge: | Generic word embeddings are trained on large-scale generic corpora, while domain specific ones are trained only on data from a domain of interest. |
| Approach: | They propose a method to combine breadth of generic and specific embeddings to form domain-specific embeddables. |
| Outcome: | The proposed method outperforms generic and domain specific embeddings on sentiment classification tasks. |
Bilingual Lexicon Induction through Unsupervised Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Existing methods for bilingual lexicon induction use nearest neighbor or related retrieval methods to induce word translation pairs. |
| Approach: | They propose a method that aligns word embeddings in two languages and uses them to build a phrase-table and a language model to extract the bilingual lexicon. |
| Outcome: | The proposed method improves accuracy 6 points over nearest neighbor and 4 points over CSLS retrieval on the same cross-lingual embeddings. |
Orthographic Features for Bilingual Lexicon Induction (P18-2)
Copied to clipboard
| Challenge: | Recent embedding-based methods do not take advantage of orthographic features, such as edit distance, which can be helpful for pairs of related languages. |
| Approach: | They propose to use orthographic features to integrate orthographic induction into embedding methods . they use document-aligned data instead of a seed dictionary to learn bilingual embedds . |
| Outcome: | This work extends embedding-based methods to incorporate orthographic features . it shows that the methods can learn bilingual embeddables in low-resource languages . |