Challenge: Existing approaches to text classification are limited by distribution drift and misprediction risk.
Approach: They propose a model risk analysis approach to adapt a pre-trained DNN model to a new dataset given only a small set of representative data.
Outcome: The proposed model performs considerably better than existing approaches on real datasets.

Similar Papers

An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models (N19-1)

Copied to clipboard

Challenge: Existing transfer learning methods employ language models pretrained on large generic corpora, but results come at a high computational cost and require task-specific architectures.
Approach: They propose a transfer learning approach that combine a task-specific optimization function with an auxiliary language model objective, which is adjusted during the training process.
Outcome: The proposed method surpasses well established transfer learning methods with greater level of complexity on a variety of affective and text classification tasks surpassing well established methods with higher level of difficulty.
Unsupervised Non-transferable Text Classification (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods to train a good deep learning model require labeled data for the target domain which can be difficult to obtain.
Approach: They propose an unsupervised non-transferable learning method that does not require annotated target domain data and introduce a secret key component for recovering the model’s access to the target domain.
Outcome: The proposed method reduces model generalization ability in specific target domains while still recovering access to the target domain.
On the Transferability of Adversarial Attacks against Neural Text Classifier (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies show that deep neural networks are vulnerable to adversarial examples . a small perturbation to an input alters the model prediction .
Approach: They propose a genetic algorithm to find models that can induce adversarial examples to fool models . they propose word replacement rules that can be used for model diagnostics from these examples .
Outcome: The proposed model can fool almost all existing models, while ignoring the data bias in the training set.
Robust Transfer Learning with Pretrained Language Models through Adapters (2021.acl-short)

Copied to clipboard

Challenge: Existing approaches to transfer learning with pretrained transformer-based language models are not robust and can be adversarial.
Approach: They propose a simple yet effective adapter-based approach to fine-tune language models on downstream tasks.
Outcome: The proposed approach improves stability and adversarial robustness in transfer learning to various downstream tasks.
Uncertainty Estimation and Reduction of Pre-trained Models for Text Regression (2022.tacl-1)

Copied to clipboard

Challenge: State-of-the-art classification and regression models are often not well calibrated and can be inaccurate.
Approach: They quantify calibration of pre- trained language models for text regression . they apply uncertainty estimates to augment training data in low-resource domains .
Outcome: The proposed model calibrations improve performance and generalizability in low-resource settings.
Transfer Learning in Natural Language Processing (N19-5)

Copied to clipboard

Challenge: supervised machine learning is based on learning in isolation, a single predictive model for a task using a dataset.
Approach: They present an overview of modern transfer learning methods in natural language processing . they review examples and case studies on how models can be integrated and adapted .
Outcome: The proposed methods improve upon the state-of-the-art on a wide range of NLP tasks.
Investigating Ensemble Methods for Model Robustness Improvement of Text Classifiers (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to reduce model's reliance on bias features ignore the learnability of these features.
Approach: They propose to reduce models' reliance on bias features by first training models with fixed low-capacity models which ignore the learnability of the bias features.
Outcome: The proposed models can perform better on out-of-distribution datasets than baseline models with a more sophisticated model design.
Harmless Transfer Learning for Item Embeddings (2022.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to learn item embeddings for categorical features are limited by the frequency of items in real-world.
Approach: They propose a method that transfers knowledge from frequent items to rare items by introducing an auxiliary transfer loss.
Outcome: The proposed framework significantly boosts the performance on a variety of NLP and recommendation system tasks.
Universal Language Model Fine-tuning for Text Classification (P18-1)

Copied to clipboard

Challenge: Existing approaches to computer vision require task-specific modifications and training from scratch.
Approach: They propose a method that can be applied to any task in NLP and propose to open-source it.
Outcome: The proposed method outperforms the state-of-the-art on six text classification tasks, reducing error by 18-24% on majority of datasets.
Cross-lingual Text Classification Transfer: The Case of Ukrainian (2025.coling-main)

Copied to clipboard

Challenge: despite the large amount of labeled datasets, there is an imbalance in data availability across languages.
Approach: They explore cross-lingual knowledge transfer methods avoiding manual data curation . they use large multilingual encoders and translation systems, LLMs, and language adapters .
Outcome: The proposed approaches are tested on three text classification tasks in Ukrainian . the authors show that the proposed approaches avoid manual data curation .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations