| Challenge: | Existing methods ignore the correlations between labels and different parts of the text can contribute differently for predicting different labels. |
| Approach: | They propose to view the multi-label classification task as a sequence generation problem and apply a decoder-based sequence generation model to solve it. |
| Outcome: | The proposed methods outperform previous work by a substantial margin. |
Similar Papers
Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multi-task learning fail to capture label correlations . Existing methods suffer from label order dependency, label combination over-fitting and error propagation problems. |
| Approach: | They propose a novel approach with multi-task learning to enhance label correlation feedback. |
| Outcome: | The proposed method outperforms baselines on AAPD and RCV1-V2 datasets. |
Hierarchical Label Generation for Text Classification (2023.findings-eacl)
Copied to clipboard
| Challenge: | None Hierarchical text classification (HTC) aims to assign the most relevant labels with their structure for a given document. |
| Approach: | They propose a method that captures the label hierarchy for real-world classification applications by using a taxonomic hierarchy. |
| Outcome: | The proposed method can generate unseen labels in subword level. |
Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification (2022.acl-short)
Copied to clipboard
| Challenge: | Existing methods for multi-label text classification neglect the knowledge from the existing similar instances when predicting labels of a specific text. |
| Approach: | They propose a k nearest neighbor mechanism which retrieves several neighbor instances and interpolates the model output with their labels. |
| Outcome: | Extensive experiments show that the proposed method can bring significant performance improvements to multiple MLTC models including state-of-the-art pretrained and non-pretrained ones. |
Label Representations in Modeling Classification as Text Generation (2020.aacl-srw)
Copied to clipboard
| Challenge: | Existing methods for text generation use strings to represent labels . linguistic properties of labels do affect performance, though their results are limited to document retrieval. |
| Approach: | They investigate the effect of string representations on how effectively a model learns a task . they use four standard text classification tasks to model string representation . |
| Outcome: | The proposed model improves on four standard text classification tasks . the results are largely negative in the low data setting . |
Large Language Models Do Multi-Label Classification Differently (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multi-label classification is prevalent in real-world settings, but the behavior of Large Language Models (LLMs) in this setting is understudied. |
| Approach: | They propose to use initial probability distributions to analyze output distributions of LLMs at each label generation step to find out how LLM models perform multi-label classification. |
| Outcome: | The proposed methods improve alignment and predictive performance over existing methods. |
Learning to Learn and Predict: A Meta-Learning Approach for Multi-Label Classification (D19-1)
Copied to clipboard
| Challenge: | Existing models for multi-label classification ignore complexity and dependencies among labels . Experimental results show that our method can obtain more accurate multi-lab classification results. |
| Approach: | They propose a meta-learning method to capture complex label dependencies . they use a Meta-learner to jointly learn the training policies and prediction policies for different labels. |
| Outcome: | The proposed method can capture complex label dependencies on fine-grained entity typing and text classification tasks. |
Adapting RNN Sequence Prediction Model to Multi-label Set Prediction (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to multi-label classification are based on pre-specifying the label order, or relating the sequence probability to the set probability in ad hoc ways. |
| Approach: | They propose a new training objective that maximizes this set probability and a prediction objective that finds the most probable set on a test document. |
| Outcome: | The proposed model outperforms existing methods on a set of labels for multi-label classification . the proposed model is based on 'set probability' and 'prediction objective' |
Enhancing Extreme Multi-Label Text Classification: Addressing Challenges in Model, Data, and Evaluation (2023.emnlp-industry)
Copied to clipboard
Dan Li, Zi Long Zhu, Janneke van de Loo, Agnes Masip Gomez, Vikrant Yadav, Georgios Tsatsaronis, Zubair Afzal
| Challenge: | Existing approaches to extreme multi-label text classification face inherent challenges in terms of model, data, and evaluation. |
| Approach: | They propose a label ranking model as an alternative to the conventional SciBERT-based classification model and an active learning-based pipeline that addresses the data scarcity of new labels during the update of a classification system. |
| Outcome: | The proposed model enables efficient handling of large-scale labels and accommodates new labels. |
Seq2Emo: A Sequence to Multi-Label Emotion Classification Model (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for multi-label emotion classification are based on binary relevance and classifier chain (CC) |
| Approach: | They propose a sequence-to-emotion approach which implicitly models emotion correlations in a bi-directional decoder. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on a SemEval’18 and GoEmotions dataset. |
Cluster-Guided Label Generation in Extreme Multi-Label Classification (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing classification-based models are poorly per-form for tail labels and ignore semantic relations among labels. |
| Approach: | They propose to guide label generation using label cluster information to hierarchically generate lower-level labels. |
| Outcome: | The proposed model outperforms classification and generation baselines on tail labels and improves in four popular XMC benchmarks. |