Domain Generalization for Text Classification with Memory-Based Supervised Contrastive Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-domain text classification focus on one-to-one domain adaptation. |
| Approach: | They propose a framework for domain generalization that uses contrastive learning with a memory-saving queue. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on Amazon review sentiment datasets and rumour detection datasets. |
Similar Papers
Mere Contrastive Learning for Cross-Domain Sentiment Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-domain sentiment analysis are labor-intensive and time-consuming. |
| Approach: | They propose a modified contrastive objective with in-batch negative samples to allow sentence representations from the same class to be pushed closer while those from the different classes become further apart in the latent space. |
| Outcome: | The proposed model can achieve state-of-the-art in cross-domain and multi-domain sentiment analysis tasks while transferring knowledge learned in the source domain to the target domain. |
Text Classification with Few Examples using Controlled Generalization (N19-1)
Copied to clipboard
| Challenge: | Current training data for text classification is limited, resulting in limited generalization capacity. |
| Approach: | They propose a feed-forward network that can generalize from unlabeled parsed corpora to produce task-specific semantic vectors. |
| Outcome: | The proposed approach is especially effective in low-data scenarios compared to state-of-the-art methods. |
Memory-Based Invariance Learning for Out-of-Domain Text Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to learning invariant representations rely on the assumption that training and test sets come from the same domain. |
| Approach: | They propose to extend a classification model trained on multiple source domains to an unseen target domain by using key-value memory. |
| Outcome: | The proposed method improves on sentiment analysis and natural language inference tasks. |
Contrastive Data and Learning for Natural Language Processing (2022.naacl-tutorials)
Copied to clipboard
| Challenge: | Current NLP models heavily rely on effective representation learning algorithms. |
| Approach: | This tutorial introduces contrastive learning and provides an introduction to the techniques. |
| Outcome: | This tutorial provides an introduction to the fundamentals of contrastive learning approaches and the theory behind them. |
Domain Generalization via Causal Adjustment for Cross-Domain Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to domain adaptation fail to generalize well on unknown test data. |
| Approach: | They propose a backdoor adjustment-based causal model to disentangle domain-specific and domain-invariant representations that play essential roles in tackling domain shift. |
| Outcome: | The proposed model disentangles domain-specific and domain-invariant representations that play essential roles in tackling domain shift. |
Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to learn contextualized and generalized sentence representations are limited by the size of manually annotated data. |
| Approach: | They propose a method to learn contextualized and generalized sentence representations using contrastive self-supervised learning. |
| Outcome: | The proposed method outperforms baseline methods based on BERT, XLNet, and RoBERTa in English and Japanese and outperformed strong baseline methods. |
What’s in a Domain? Learning Domain-Robust Text Representations using Adversarial Training (N18-2)
Copied to clipboard
| Challenge: | a key roadblock is application to new domains, unseen in training. |
| Approach: | They propose a method to optimise in- and out-of-domain accuracy by combing domain-specific and domain-general components with adversarial training for domain. |
| Outcome: | The proposed method improves on domain adaptation and domain-adversarial training. |
Robust Semantic Parsing with Adversarial Learning for Domain Generalization (N19-2)
Copied to clipboard
| Challenge: | Using adversarial learning to train models on a higher level of abstraction to increase their robustness to lexical and stylistic variations is crucial for the integration of Semantic Parsing technologies in real applications. |
| Approach: | They propose to perform Semantic Parsing with a domain classification adversarial task and an unsupervised domain discovery approach that yields equivalent improvements. |
| Outcome: | The proposed approach improves on a French corpus of encyclopedic documents annotated with FrameNet and an unsupervised domain discovery approach yields equivalent improvements. |
Unsupervised Energy-based Adversarial Domain Adaptation for Cross-domain Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Extensive experiments on multidomain sentiment classification and yes/no question-answering classification are conducted. |
| Approach: | They propose an unsupervised energy-based adversarial domain adaptation framework that maps the text sequences from both source and target domains to a feature space. |
| Outcome: | The proposed framework improves on multidomain sentiment classification and Yes/No question-answering classification. |
Adaptive Semi-supervised Learning for Cross-domain Sentiment Classification (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-domain sentiment classification are difficult and costly . domain adaptation is difficult because data in source and target domains are drawn from different distributions. |
| Approach: | They propose a semi-supervised learning approach that minimizes the distance between source and target instances in embedded feature space. |
| Outcome: | The proposed approach can improve on baseline methods in various settings. |