Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work on the hierarchical text classification problem is limited due to the complexity of label hierarchy and intensive labeling cost. |
| Approach: | They propose a path-based few-shot setting and a strict path-basic evaluation metric to further explore few- shot HTC tasks. |
| Outcome: | The proposed framework outperforms those who inject hierarchy through graph encoders on three popular HTC datasets under the few-shot setting. |
Similar Papers
NER-guided Comprehensive Hierarchy-aware Prompt Tuning for Hierarchical Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a challenging task in natural language processing due to its complex taxonomic label hierarchy. |
| Approach: | They propose to use prompts to model hierarchical text classification (HTC) they propose to introduce conditional random fields and Global Pointer to establish hierarchic dependencies . |
| Outcome: | The proposed approach achieves state-of-the-art (SoTA) performance on three public datasets. |
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification are lacking in the field of natural language processing. |
| Approach: | They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels. |
| Outcome: | The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro. |
HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a multi-label classification problem with a complex label hierarchy. |
| Approach: | They propose a Hierarchy-aware Prompt Tuning method to handle HTC from a multi-label perspective using a dynamic virtual template and label words that take the form of soft prompts to fuse the label hierarchy knowledge. |
| Outcome: | The proposed method achieves state-of-the-art performance on 3 popular HTC datasets and is adept at handling imbalance and low resource situations. |
Ensembling Prompting Strategies for Zero-Shot Hierarchical Text Classification with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification is a challenging task in natural language processing. |
| Approach: | They propose a method which integrates the results of diverse prompting strategies to promote LLMs’ reliability. |
| Outcome: | The proposed method boosts the performance of single prompting strategies and achieves SOTA results on three benchmark datasets. |
Enhancing Few-Shot Topic Classification with Verbalizers. a Study on Automatic Verbalizer and Ensemble Methods (2024.lrec-main)
Copied to clipboard
Quang Anh Nguyen, Nadi Tomeh, Mustapha Lebbah, Thierry Charnois, Hanene Azzag, Santiago Cordoba Muñoz
| Challenge: | Pretrained language models are increasingly being used for many tasks. |
| Approach: | They propose to use verbalizers to help interpret masked word distributions into output predictions. |
| Outcome: | The proposed approach outperforms models trained with individual templates while using significantly less resources. |
Label-Aware Automatic Verbalizer for Few-Shot Text Classification in Mid-To-Low Resource Languages (2024.acl-srw)
Copied to clipboard
| Challenge: | Prompt-based learning has shown its effectiveness in few-shot text classification. |
| Approach: | They propose a prompt-based learning verbalizer that automatically selects a word to represent each class . they use the label name along with the conjunction "and" to induce the model to generate more effective words for the verbaliser. |
| Outcome: | The proposed method outperforms existing verbalizers on four Southeast Asian languages. |
Hierarchical Attention Prototypical Networks for Few-Shot Text Classification (D19-1)
Copied to clipboard
| Challenge: | Existing methods for text classification are based on large-scale labeled data, but few data are available. |
| Approach: | They propose a hierarchical attention prototypical networks for few-shot text classification . they use attention mechanism to highlight or weaken the importance of features, words, and instances . |
| Outcome: | The proposed model can capture more important features, words, and instances . it can also increase support set augmentability and accelerate convergence speed in training stage . |
Prompt-Tuned Muti-Task Taxonomic Transformer (PTMTTaxoFormer) (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for Hierarchical Text Classification (HTC) are expensive and require explicit injection of the hierarchy, verbalizers, and/or prompt engineering. |
| Approach: | They propose a hierarchical text classification system that uses a single classifier to predict one or more topics using differentiable prompts and labels that are learnt through backpropagation. |
| Outcome: | The proposed model outperforms existing models on several benchmarks that span a range of topics consistently. |
HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classification (2024.eacl-long)
Copied to clipboard
| Challenge: | Hierarchical text classification is a complex subtask under multi-label text classification . the relevance of document sections can vary based on the hierarchy level, necessitating a dynamic document representation. |
| Approach: | They propose a text-generation-based framework that uses language models to encode dynamic text representations. |
| Outcome: | The proposed framework surpasses existing methods while handling data and mitigating class imbalance. |
Prototypical Verbalizer for Prompt-based Few-shot Tuning (2022.acl-long)
Copied to clipboard
| Challenge: | Prompt-based tuning for pre-trained language models has shown its effectiveness in few-shot learning. |
| Approach: | They propose a prototypical verbalizer which learns prototype vectors as verbalizes by contrastive learning. |
| Outcome: | The proposed verbalizer outperforms existing verbalizing methods on topic classification and entity typing tasks. |