NER-guided Comprehensive Hierarchy-aware Prompt Tuning for Hierarchical Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a challenging task in natural language processing due to its complex taxonomic label hierarchy. |
| Approach: | They propose to use prompts to model hierarchical text classification (HTC) they propose to introduce conditional random fields and Global Pointer to establish hierarchic dependencies . |
| Outcome: | The proposed approach achieves state-of-the-art (SoTA) performance on three public datasets. |
Similar Papers
HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a multi-label classification problem with a complex label hierarchy. |
| Approach: | They propose a Hierarchy-aware Prompt Tuning method to handle HTC from a multi-label perspective using a dynamic virtual template and label words that take the form of soft prompts to fuse the label hierarchy knowledge. |
| Outcome: | The proposed method achieves state-of-the-art performance on 3 popular HTC datasets and is adept at handling imbalance and low resource situations. |
Prompt-Tuned Muti-Task Taxonomic Transformer (PTMTTaxoFormer) (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for Hierarchical Text Classification (HTC) are expensive and require explicit injection of the hierarchy, verbalizers, and/or prompt engineering. |
| Approach: | They propose a hierarchical text classification system that uses a single classifier to predict one or more topics using differentiable prompts and labels that are learnt through backpropagation. |
| Outcome: | The proposed model outperforms existing models on several benchmarks that span a range of topics consistently. |
Dual Prompt Tuning based Contrastive Learning for Hierarchical Text Classification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focus on hierarchy-aware text feature by exploiting explicit parent-child relationships, resulting in label confusion within each layer. |
| Approach: | They propose a dual-prompt tuning method which emphasizes discrimination among peer labels by performing contrastive learning on each hierarchical layer. |
| Outcome: | The proposed method outperforms existing methods on benchmark datasets and is available on github. |
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work on the hierarchical text classification problem is limited due to the complexity of label hierarchy and intensive labeling cost. |
| Approach: | They propose a path-based few-shot setting and a strict path-basic evaluation metric to further explore few- shot HTC tasks. |
| Outcome: | The proposed framework outperforms those who inject hierarchy through graph encoders on three popular HTC datasets under the few-shot setting. |
Well Begun Is Half Done: An Implicitly Augmented Generative Framework with Distribution Modification for Hierarchical Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Hierarchical Text Classification (HTC) is a challenging task which aims to extract the labels in a tree structure corresponding to a given text. |
| Approach: | They propose an explicit-agmented-generativ-e framework with distribution modification for hierarchical text classification. |
| Outcome: | The proposed framework improves on the initial distributions of tail classes and avoids misinterpreting predictions on unbalanced data. |
Global and Local Hierarchical Prompt Tuning Framework for Multi-level Implicit Discourse Relation Recognition (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent methods to recognize hierarchical discourse relations without explicit connectives are inefficient and ignore the utilization of the output probability distribution information of the verbalizer. |
| Approach: | They propose a global and local hierarchical prompt tuning framework which leverages top-up propagated probability as the global hierarchy to inject it into multi-level verbalizer. |
| Outcome: | The proposed framework achieves competitive results on two benchmacks. |
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification are lacking in the field of natural language processing. |
| Approach: | They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels. |
| Outcome: | The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro. |
Developing Prefix-Tuning Models for Hierarchical Text Classification (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a key task in many industrial applications. Pre-trained Language Models (PLMs) have become dominant for most natural language processing (NLP) tasks. |
| Approach: | They investigate how prefix tuning can improve hierarchical text classification . prefix-tuning model only needs less than 1% of parameters to achieve performance . |
| Outcome: | The proposed model can achieve comparable performance to regular full fine-tuning. |
Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognition (2023.acl-long)
Copied to clipboard
| Challenge: | Multi-level implicit discourse relation recognition (MIDRR) aims at identifying hierarchical discourse relations among arguments. |
| Approach: | They propose a prompt-based multi-level implicit discourse relation recognition framework that leverages parameter-efficient prompt tuning to drive inputted arguments to match the pre-trained space. |
| Outcome: | The proposed framework achieves comparable results on PDTB 2.0 and 3.0 using about 0.1% trainable parameters compared with baselines. |
Ensembling Prompting Strategies for Zero-Shot Hierarchical Text Classification with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification is a challenging task in natural language processing. |
| Approach: | They propose a method which integrates the results of diverse prompting strategies to promote LLMs’ reliability. |
| Outcome: | The proposed method boosts the performance of single prompting strategies and achieves SOTA results on three benchmark datasets. |