| Challenge: | Existing models for text representations have shown state-of-the-art performance on text classification tasks, however, the discrepancy between semantic similarity of texts and labelling standards affects classifiers. |
| Approach: | They propose a simple multitask learning model that uses negative supervision to generate distinct representations for texts with different labels. |
| Outcome: | The proposed model outperforms state-of-the-art models on classification tasks in three different languages. |
Similar Papers
Multitask Semi-Supervised Learning for Class-Imbalanced Discourse Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Discourse learning is a complex task, and schemas evolve across annotation efforts preventing compilation of smaller datasets into larger ones. |
| Approach: | They propose a multitask learning approach that can combine discourse datasets from similar and diverse domains to improve discourse classification. |
| Outcome: | The proposed approach improves on the NewsDiscourse dataset by 4.9% over current state-of-the-art benchmarks on one of the largest discourse datasets. |
Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Fine-grained classification tasks involve distinguishing between classes with subtle differences between them. |
| Approach: | They analyse fine-grained text classification tasks by embedding class relationships into a contrastive objective function to help differently weigh the positives and negatives. |
| Outcome: | The proposed model outperforms previous contrastive methods on emotion classification and sentiment analysis. |
Denoising Multi-Source Weak Supervision for Neural Text Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have witnessed the rapid development of deep neural networks (DNNs) for text classification problems. |
| Approach: | They propose a label denoiser which estimates the source reliability using a conditional soft attention mechanism and reduces label noise by aggregating rule-annotated weak labels. |
| Outcome: | The proposed model outperforms state-of-the-art methods on sentiment, topic, and relation classifications and achieves comparable performance with fully-supervised methods even without labeled data. |
Label Representations in Modeling Classification as Text Generation (2020.aacl-srw)
Copied to clipboard
| Challenge: | Existing methods for text generation use strings to represent labels . linguistic properties of labels do affect performance, though their results are limited to document retrieval. |
| Approach: | They investigate the effect of string representations on how effectively a model learns a task . they use four standard text classification tasks to model string representation . |
| Outcome: | The proposed model improves on four standard text classification tasks . the results are largely negative in the low data setting . |
Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification (2022.acl-short)
Copied to clipboard
| Challenge: | Existing methods for multi-label text classification neglect the knowledge from the existing similar instances when predicting labels of a specific text. |
| Approach: | They propose a k nearest neighbor mechanism which retrieves several neighbor instances and interpolates the model output with their labels. |
| Outcome: | Extensive experiments show that the proposed method can bring significant performance improvements to multiple MLTC models including state-of-the-art pretrained and non-pretrained ones. |
LIME: Weakly-Supervised Text Classification without Seeds (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to weakly-supervised text classification use only label names as sources of supervision. |
| Approach: | They propose a framework for weakly-supervised text classification that replaces seed-word generation with entailment-based pseudo-classification. |
| Outcome: | The proposed framework outperforms baselines and state-of-the-art in 4 benchmarks. |
Friend-training: Learning from Models of Different but Related Tasks (2023.eacl-main)
Copied to clipboard
| Challenge: | Current self-training methods focus on improving model performance on a single task. |
| Approach: | They propose a cross-task self-training framework where models trained to do different tasks are used in iterative training, pseudo-labeling, and retraining processes to help each other for better selection of pseudo-labeled labels. |
| Outcome: | The proposed framework achieves the best performance compared to baselines on two dialogue understanding tasks. |
Do Text-to-Text Multi-Task Learners Suffer from Task Conflict? (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing multi-task learning architectures learn a single model across multiple tasks through a shared encoder followed by task-specific decoders. |
| Approach: | They propose to use a shared encoder and language model decoder to learn a single model across multiple tasks. |
| Outcome: | The proposed architecture does surprisingly well across a range of diverse tasks. |
Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for text classification suffer from the semantic drift problem, which is a problem for self-training. |
| Approach: | They propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. |
| Outcome: | The proposed model outperforms ten baseline models in five benchmarks and is additive to language model pretraining. |
An Effective Deployment of Contrastive Learning in Multi-label Text Classification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on contrastive learning in natural language processing tasks have not explored the effectiveness of the technology. |
| Approach: | They propose five novel contrastive losses for multi-label text classification tasks that exploit the complexity of the input logic and the semantic representation space. |
| Outcome: | The proposed contrastive losses improve multi-label text classification tasks and can be adapted for multi-task tasks. |