An Exploration of Encoder-Decoder Approaches to Multi-Label Classification for Legal and Biomedical Text (2023.findings-acl)
Copied to clipboard
| Challenge: | Standard methods for multi-label text classification rely on encoder-only pre-trained models . encoder decoder models have proven more effective in other classification tasks . |
| Approach: | They compare four methods for multi-label classification based on encoder-only models . they use a pre-trained model for multilabel text classification . |
| Outcome: | The proposed methods outperform encoder-only methods on complex datasets and labeling schemes. |
Similar Papers
Bringing Emerging Architectures to Sequence Labeling in NLP (2026.eacl-long)
Copied to clipboard
| Challenge: | Pretrained Transformer encoders are the dominant approach to sequence labeling . however, few have been applied to sequence labels on flat or simplified tasks . |
| Approach: | They propose to use pretrained Transformer encoders to model relations across words . they find that the architectures adapt well across tagging tasks that vary in complexity . |
| Outcome: | The proposed architectures perform well across tagging tasks across languages and datasets. |
Practical Transformer-based Multilingual Text Classification (2021.naacl-industry)
Copied to clipboard
| Challenge: | XNLI does not reflect the data availability and task variety of industry applications. |
| Approach: | They compare transformer-based text classification methods to multilingual models in five different languages . they use a task- and domain-adaptive pretraining and data augmentation technique . |
| Outcome: | The proposed methods outperform monolingual models on two tasks in five languages . the results show that practical modifications can improve model performance without labeling . |
Hierarchical Label Generation for Text Classification (2023.findings-eacl)
Copied to clipboard
| Challenge: | None Hierarchical text classification (HTC) aims to assign the most relevant labels with their structure for a given document. |
| Approach: | They propose a method that captures the label hierarchy for real-world classification applications by using a taxonomic hierarchy. |
| Outcome: | The proposed method can generate unseen labels in subword level. |
SGM: Sequence Generation Model for Multi-label Classification (C18-1)
Copied to clipboard
| Challenge: | Existing methods ignore the correlations between labels and different parts of the text can contribute differently for predicting different labels. |
| Approach: | They propose to view the multi-label classification task as a sequence generation problem and apply a decoder-based sequence generation model to solve it. |
| Outcome: | The proposed methods outperform previous work by a substantial margin. |
Investigating Active Learning Sampling Strategies for Extreme Multi Label Text Classification (2022.lrec-1)
Copied to clipboard
| Challenge: | Large scale, multi-label text datasets with high numbers of different classes are expensive to annotate due to domain experts taking a lot of time working through all the classes. |
| Approach: | They propose to build classifiers on multi-label text datasets using Active Learning to reduce labeling effort. |
| Outcome: | The proposed classifiers can be used to reduce labeling effort on multi-label datasets. |
Aggregating and Learning from Multiple Annotators (2021.eacl-tutorials)
Copied to clipboard
| Challenge: | NLP is based on high-quality annotated datasets, but many other tasks have unique characteristics not considered by standard models of annotation. |
| Approach: | tutorial aims to connect NLP researchers with state-of-the-art aggregation models for canonical language annotation tasks. |
| Outcome: | This tutorial aims to connect NLP researchers with state-of-the-art aggregation models for a diverse set of canonical language annotation tasks. |
Multi-Source Text Classification for Multilingual Sentence Encoder with Machine Translation (2024.naacl-srw)
Copied to clipboard
| Challenge: | Pre-trained multilingual sentence encoders suffer from performance degradation for non-English languages. |
| Approach: | They propose a method of machine translating a source sentence into English and then inputting it together with the source sentence in a multi-source manner. |
| Outcome: | The proposed method improves the performance of pre-trained multilingual sentence encoders in Japanese on sentiment analysis and topic classification tasks. |
Label-semantics Aware Generative Approach for Domain-Agnostic Multilabel Classification (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multi-label text classification are limited by textual data. |
| Approach: | They propose a domain-agnostic generative model framework for multi-label text classification that generates predefined label descriptions and matches them to predefined labels. |
| Outcome: | The proposed model achieves 13.94% and 24.85% performance over all datasets. |
More Embeddings, Better Sequence Labelers? (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work suggests contextual embeddings improve sequence labeling accuracy . but, there is no definite conclusion on whether concatenating different kinds of embeddables is effective . |
| Approach: | They propose a family of contextual embeddings that improves sequence labeling accuracy . they conduct extensive experiments on 3 tasks over 18 datasets and 8 languages . |
| Outcome: | The proposed family of contextual embeddings improves the accuracy of sequence labelers over non-contextual embedders. |
Large Language Models Do Multi-Label Classification Differently (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multi-label classification is prevalent in real-world settings, but the behavior of Large Language Models (LLMs) in this setting is understudied. |
| Approach: | They propose to use initial probability distributions to analyze output distributions of LLMs at each label generation step to find out how LLM models perform multi-label classification. |
| Outcome: | The proposed methods improve alignment and predictive performance over existing methods. |