| Challenge: | Existing neural models for learning under domain shifts only evaluate on a single task, on proprietary datasets, or compare to weak baselines. |
| Approach: | They propose a multi-task tri-training method that reduces time and space complexity of classic bootstrapping approaches. |
| Outcome: | The proposed method outperforms the state-of-the-art for sentiment analysis on two benchmarks. |
Similar Papers
Adaptive Semi-supervised Learning for Cross-domain Sentiment Classification (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-domain sentiment classification are difficult and costly . domain adaptation is difficult because data in source and target domains are drawn from different distributions. |
| Approach: | They propose a semi-supervised learning approach that minimizes the distance between source and target instances in embedded feature space. |
| Outcome: | The proposed approach can improve on baseline methods in various settings. |
Neural Unsupervised Domain Adaptation in NLP—A Survey (2020.coling-main)
Copied to clipboard
| Challenge: | Deep neural networks excel at learning from labeled data, but learning from unlabeled data remains a challenge. |
| Approach: | They review neural unsupervised domain adaptation techniques which do not require labeled target domain data. |
| Outcome: | The proposed techniques are more challenging yet widely applicable. |
What can we learn from Semantic Tagging? (D18-1)
Copied to clipboard
| Challenge: | a recent study shows that multi-task learning improves performance of NLP tasks by exploiting similarities between tasks. |
| Approach: | They employ semantic tagging as an auxiliary task for three NLP tasks . they compare full neural network sharing, partial neural network shared and learning what to share . |
| Outcome: | The proposed model improves for part-of-speech tagging, universal dependency parsing and natural language inference. |
Learning Domain Representation for Multi-Domain Sentiment Classification (N18-1)
Copied to clipboard
| Challenge: | Training data for sentiment analysis is abundant in multiple domains, yet scarce for other domains. |
| Approach: | They propose to use domain-specific representations of input sentences to improve sentiment classification . they use a descriptor vector to map adversarially trained domain-general Bi-LSTM inputs into domain- specific representations . |
| Outcome: | The proposed model outperforms existing methods on multi-domain sentiment analysis significantly. |
Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces (N18-1)
Copied to clipboard
| Challenge: | Multi-task learning and semi-supervised learning are successful paradigms for learning in scenarios with limited labelled data. |
| Approach: | They propose to induce a joint embedding space between disparate label spaces and learning transfer functions between label embeddments to leverage unlabelled data and auxiliary, annotated datasets. |
| Outcome: | The proposed approach outperforms strong single and multi-task baselines and achieves state of the art on aspect-based and topic-based sentiment analysis. |
Rethinking Semi-supervised Learning with Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Semi-supervised learning (SSL) is a popular setting to make use of unlabelled data . Currently, there are two popular approaches to make effective use of the unlabelled datasets . |
| Approach: | They compare semi-supervised learning (SSL) and task-adaptive pre-training (TAPT) they find TAPT is a stronger and more robust SSL learner, even when using just a few hundred unlabelled samples . |
| Outcome: | The proposed methods improve model performance across different NLP tasks and data sizes. |
Even the Simplest Baseline Needs Careful Re-investigation: A Case Study on XML-CNN (2022.naacl-main)
Copied to clipboard
| Challenge: | XML-CNN has been a popular research topic in NLP due to its superior performance . however, the increasing complexity brings difficulties to ensure the true architectural progress . |
| Approach: | They propose to re-examine an influential multi-label text classification method . they propose suitable baselines for multi-level text classification tasks . |
| Outcome: | The proposed method performs better than the original model, the authors show . they show that the re-implementation reveals contradictory results to the original work . |
To Annotate or Not? Predicting Performance Drop under Domain Shift (D19-1)
Copied to clipboard
| Challenge: | Performance drop due to domain-shift is an endemic problem for NLP models in production. |
| Approach: | They propose to use H-divergence, reverse classification accuracy and confidence measures to predict performance drop under domain-shift without any target domain labels. |
| Outcome: | The proposed method predicts performance drops with an error rate as low as 2.15% and 0.89% for sentiment analysis and POS tagging respectively. |
Semi-Supervised Domain Adaptation for Emotion-Related Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Semi-supervised domain adaptation (SSDA) is a model trained from a label-rich source domain to a new but related domain with a few labels of target data. |
| Approach: | They propose to decompose the semi-supervised domain adaptation framework into two subcomponents of unsupervised domain adaption (UDA) from the source to the target domain and semi-supervised learning (SSL) in the target. |
| Outcome: | The proposed method is based on the co-learning of multiple classifiers for computer vision tasks and is published in the journal Nature. |
Revisiting Multi-Domain Machine Translation (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches to handle multi-domain machine translation systems are lacking due to the variability of data. |
| Approach: | They propose to use domain adaptation methods to handle situations where a sample of matched sentences is available in training and where only samples of source-side sentences are available. |
| Outcome: | The proposed model is able to handle multiple domains and their expectations with respect to performance. |