Challenge: Text classification is a fundamental problem in natural language processing, but its performance relies on high-quality annotations.
Approach: They propose to use model-agnostic methods to handle inherent noise in large scale text classification that can be easily incorporated into existing machine learning workflows with minimal interruption.
Outcome: The proposed method outperforms baselines by up to 10% in classification accuracy while requiring no network modifications.

Similar Papers

Noise Learning for Text Classification: A Benchmark (2022.coling-1)

Copied to clipboard

Challenge: Existing noise learning methods for text classification are underdeveloped . authors propose a noise learning benchmark for text classification .
Approach: They propose to use four state-of-the-art methods of noise learning from the image domain to classify text.
Outcome: The proposed benchmark of noise learning for text classification is based on four methods and five noise modes.
An Effective Label Noise Model for DNN Text Classification (N19-1)

Copied to clipboard

Challenge: Existing methods to train deep neural networks with label noise are limited to image classification models . label noise is important because of the large number of errors and errors in training datasets .
Approach: They propose a non-linear processing layer that models label noise into a convolutional neural network (CNN) they add a noise model layer on top of their target model to account for label noise .
Outcome: The proposed approach is robust to label noise and can learn better sentences . it is based on extensive experiments on text classification datasets .
Investigating Ensemble Methods for Model Robustness Improvement of Text Classifiers (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to reduce model's reliance on bias features ignore the learnability of these features.
Approach: They propose to reduce models' reliance on bias features by first training models with fixed low-capacity models which ignore the learnability of the bias features.
Outcome: The proposed models can perform better on out-of-distribution datasets than baseline models with a more sophisticated model design.
Robust to Noise Models in Natural Language Processing Tasks (P19-2)

Copied to clipboard

Challenge: Existing spelling correction systems are far from perfect for noise-sensitive texts . a new way to handle noise is to make models robust to noise.
Approach: They propose a robust to noise word embeddings model which outperforms existing models in different tasks.
Outcome: The proposed model outperforms existing models in three downstream tasks and shows improvements in noise robustness over existing models.
Label Agnostic Pre-training for Zero-shot Text Classification (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to text classification assume a fixed set of labels . however, in real-world applications, there exists an infinite label space for describing a given text .
Approach: They propose two new methods that inject aspect-level understanding into pre-trained models at train time to improve zero-shot generalization.
Outcome: The proposed methods improve zero-shot generalization on a set of challenging datasets.
Text Classification with Few Examples using Controlled Generalization (N19-1)

Copied to clipboard

Challenge: Current training data for text classification is limited, resulting in limited generalization capacity.
Approach: They propose a feed-forward network that can generalize from unlabeled parsed corpora to produce task-specific semantic vectors.
Outcome: The proposed approach is especially effective in low-data scenarios compared to state-of-the-art methods.
NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processing (2023.findings-acl)

Copied to clipboard

Challenge: Large-scale datasets in the real world often contain label noise, which can cause model overfitting and degrade generalization.
Approach: They propose to use label noise to imitate human errors in annotations . they use a noisy label noise benchmark to evaluate their methods .
Outcome: The proposed benchmarks are different from data with heterogeneous label noises in the real world.
Methods for Estimating and Improving Robustness of Language Models (2022.naacl-srw)

Copied to clipboard

Challenge: Large language models suffer from weak generalisation ability due to shallow textual relations over full semantic complexity of the problem.
Approach: They propose to incorporate some of these measures into training objectives to enhance distributional robustness of LLMs.
Outcome: The proposed models outperform human models on complex tasks and outperformed other models on deep networks.
Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks (2020.acl-main)

Copied to clipboard

Challenge: Existing graph-based methods for text classification cannot capture contextual word relationships within each document nor can they produce inductive learning of new words.
Approach: They propose to use Graph Neural Networks to learn the local word representations and then aggregate the word nodes as the document embeddings.
Outcome: The proposed method outperforms state-of-the-art methods on four benchmark datasets.
Exploring Ordinality in Text Classification: A Comparative Study of Explicit and Implicit Techniques (2024.findings-acl)

Copied to clipboard

Challenge: Ordinal classification (OC) is a key task in natural language processing with applications in various domains such as sentiment analysis, rating prediction, and more.
Approach: They propose to tackle ordinal classification (OC) through the implicit semantics of the labels . they propose to use a classical explicit approach and an implicit approach that organically engages the semantics.
Outcome: The proposed methods are based on pre-trained language models and offer strategic recommendations based upon specific settings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations