HSCNN: A Hybrid-Siamese Convolutional Neural Network for Extremely Imbalanced Multi-label Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to solve the data imbalance problem are limited in extremely imbalanced data. |
| Approach: | They propose a hybrid approach which adapts general networks for head categories and few-shot techniques for tail categories. |
| Outcome: | The proposed approach improves the performance of Single networks with diverse loss objectives on tail or entire categories. |
Similar Papers
HGCN4MeSH: Hybrid Graph Convolution Network for MeSH Indexing (2020.acl-srw)
Copied to clipboard
| Challenge: | Recent deep learning methods for MeSH indexing fail to capture complex correlations between terms. |
| Approach: | They propose a model to learn the relationship between MeSH terms using Graph Convolution Network (GCN) they use two biGRUs to learn embedding representations of abstract and title of MeSH index text . |
| Outcome: | The proposed model is competitive with the state-of-the-art models on two datasets. |
Label-Specific Dual Graph Neural Network for Multi-Label Text Classification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies for multi-label text classification do not explore label-specific semantic components from documents. |
| Approach: | They propose a label-specific dual graph neural network that incorporates category information to learn label-related components from documents. |
| Outcome: | The proposed model outperforms state-of-the-art models on three benchmark datasets and achieves better performance with respect to tail labels. |
HFT-CNN: Learning Hierarchical Category Structure for Multi-label Short Text Categorization (D18-1)
Copied to clipboard
| Challenge: | Existing methods for categorization of short texts use non-hierarchical flat model, but they are limited by domain-independent knowledge distribution. |
| Approach: | They propose a method which leverages hierarchical relationships between pre-defined categories to tackle the data sparsity problem. |
| Outcome: | The proposed method is competitive with the state-of-the-art methods on a multi-label categorization task for short texts using two benchmark datasets. |
Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distribution (2021.emnlp-main)
Copied to clipboard
| Challenge: | Multi-label text classification is a challenging task because it requires capturing label dependencies. |
| Approach: | They propose to use distribution-balanced loss functions to solve label dependency problems in multi-label text classification by capturing label dependencies from a fixed-set of labels. |
| Outcome: | The proposed loss function addresses both the class imbalance and label linkage problems and outperforms other loss functions. |
Few-Shot Learning with Siamese Networks and Label Tuning (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that few-shot text classification is a poor solution for training data-intensive tasks. |
| Approach: | They propose a method that embeds texts and labels into classifiers with proper pre-training. |
| Outcome: | The proposed approach reduces inference cost by increasing the number of labels and embeddings. |
Meta-LMTC: Meta-Learning for Large-Scale Multi-Label Text Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale multi-label text classification tasks often face long-tailed label distributions, where many labels have few or even no training instances. |
| Approach: | They propose a meta-learning approach that incorporates the objective of adapting to new low-resource tasks into the meta-Learning phase. |
| Outcome: | The proposed approach achieves state-of-the-art against strong baselines and can still enhance powerful BERTlike models. |
Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to hierarchical multi-label text classification (HMTC) ignore the correlation between similar samples and introduce noise . |
| Approach: | They propose a semi-supervised method that uses a label hierarchy to bring text and label embeddings closer to each other by supervised contrastive learning. |
| Outcome: | The proposed method bridges the gap between supervised contrastive learning and HMTC by bringing text and label embeddings closer. |
Hierarchical Multi-label Text Classification with Horizontal and Vertical Category Correlations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to hierarchical multi-label text classification ignore vertical category correlations or exploit dependencies across levels without considering horizontal correlations . |
| Approach: | They propose a hierarchical multi-label text classification framework that considers both vertical and horizontal category correlations. |
| Outcome: | The proposed framework improves on real-world HMTC datasets with significant improvements over baselines. |
EnSidNet: Enhanced Hybrid Siamese-Deep Network for grouping clinical trials into drug-development pathways (2021.naacl-main)
Copied to clipboard
| Challenge: | Siamese Neural Networks have been widely used to perform similarity classification in multi-class settings. |
| Approach: | They propose an Enhanced hybrid Siamese-Deep Neural Network (EnSidNet) that can be used to group clinical trials belonging to the same drug-development pathway along the several clinical trial phases. |
| Outcome: | The proposed model shows significant improvement above baselines in a 1-shot evaluation setting and in . a classical similarity setting. |
Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for text classification suffer from the semantic drift problem, which is a problem for self-training. |
| Approach: | They propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. |
| Outcome: | The proposed model outperforms ten baseline models in five benchmarks and is additive to language model pretraining. |