Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification (D18-1)
Copied to clipboard
| Challenge: | a novel model for multi-label text classification is proposed for the task of assigning multiple labels for a given text. |
| Approach: | They propose a novel model for multi-label text classification based on sequence-to-sequence learning and a hybrid attention mechanism that extracts both the word-level and the semantic unit. |
| Outcome: | The proposed model is competitive to the baseline models and more robust to classifying low-frequency labels. |
Similar Papers
From Text Segmentation to Enhanced Representation Learning: A Novel Approach to Multi-Label Classification for Long Texts (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models rely on pre-trained language models, which have a maximum input sequence length of 512 tokens, and therefore have 'input length limitation'. |
| Approach: | They propose a text segmentation algorithm which guarantees to produce the optimal segmentation to address the issue of input length limitation caused by PLMs. |
| Outcome: | The proposed method improves both text and label representations on MLTC datasets, unraveling the intricate correlations between texts and labels. |
Label-semantics Aware Generative Approach for Domain-Agnostic Multilabel Classification (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multi-label text classification are limited by textual data. |
| Approach: | They propose a domain-agnostic generative model framework for multi-label text classification that generates predefined label descriptions and matches them to predefined labels. |
| Outcome: | The proposed model achieves 13.94% and 24.85% performance over all datasets. |
SGM: Sequence Generation Model for Multi-label Classification (C18-1)
Copied to clipboard
| Challenge: | Existing methods ignore the correlations between labels and different parts of the text can contribute differently for predicting different labels. |
| Approach: | They propose to view the multi-label classification task as a sequence generation problem and apply a decoder-based sequence generation model to solve it. |
| Outcome: | The proposed methods outperform previous work by a substantial margin. |
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification are lacking in the field of natural language processing. |
| Approach: | They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels. |
| Outcome: | The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro. |
Augmented Natural Language for Generative Sequence Labeling (2020.emnlp-main)
Copied to clipboard
| Challenge: | generative framework for joint sequence labeling and sentence-level classification is general purpose, performing well on few-shot learning, low resource, and high resource tasks. |
| Approach: | They propose a generative framework for joint sequence labeling and sentence-level classification . their framework incorporates label semantics and shares knowledge across tasks . |
| Outcome: | The proposed model performs on few-shot learning, slot labeling, and intent classification benchmarks. |
Text Classification with Few Examples using Controlled Generalization (N19-1)
Copied to clipboard
| Challenge: | Current training data for text classification is limited, resulting in limited generalization capacity. |
| Approach: | They propose a feed-forward network that can generalize from unlabeled parsed corpora to produce task-specific semantic vectors. |
| Outcome: | The proposed approach is especially effective in low-data scenarios compared to state-of-the-art methods. |
Label Semantic Aware Pre-training for Few-shot Text Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models for text classification use label semantics but few studies have attempted to give models access to informative representations of labels. |
| Approach: | They propose to use label semantics to train generative models by performing secondary pre-training on labeled sentences from a variety of domains. |
| Outcome: | The proposed approach improves generalization and data efficiency of text classification systems while maintaining comparable performance to state-of-the-art models. |
Compositional Generalization for Neural Semantic Parsing via Span-level Supervised Attention (2021.naacl-main)
Copied to clipboard
Pengcheng Yin, Hao Fang, Graham Neubig, Adam Pauls, Emmanouil Antonios Platanios, Yu Su, Sam Thomson, Jacob Andreas
| Challenge: | Existing approaches to compositional generalization in semantic parsers focus on word-level alignments, but they focus on spans. |
| Approach: | They propose a span-level supervised attention loss that improves compositional generalization in semantic parsers by focusing on spans. |
| Outcome: | The proposed method improves on three benchmarks of compositional generalization. |
Hierarchical Label Generation for Text Classification (2023.findings-eacl)
Copied to clipboard
| Challenge: | None Hierarchical text classification (HTC) aims to assign the most relevant labels with their structure for a given document. |
| Approach: | They propose a method that captures the label hierarchy for real-world classification applications by using a taxonomic hierarchy. |
| Outcome: | The proposed method can generate unseen labels in subword level. |
Task-Aware Representation of Sentences for Generic Text Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to text classification use a transformer architecture with a linear layer on top. |
| Approach: | They propose a transformer-based approach that outputs a class distribution for a given prediction problem. |
| Outcome: | The proposed model outperforms existing approaches on small training data and can learn to predict new classes even with no training examples. |