Challenge: Existing dual-encoder methods in HTC achieve weak performance gains with huge memory overheads and their structure encoders heavily rely on domain knowledge.
Approach: They propose a hierarchy-aware tree isomorphism network to enhance the text representations with only syntactic information of the label hierarchy.
Outcome: The proposed model could boost the performance of hierarchical text classification without prior statistics or label semantics without prior data.

Similar Papers

HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification (2024.naacl-long)

Copied to clipboard

Challenge: Existing self-supervised methods in natural language processing rely on augmentation rules to generate contrastive samples.
Approach: They propose a hierarchy-aware information lossless contrastive learning scheme that uses syntactic information reserved in the input sample and fused during the learning process.
Outcome: The proposed learning scheme is superior to existing methods in hierarchical text classification . the proposed learning system is based on a structure encoder and a text encoder .
Hierarchical Information Matters: Text Classification via Tree Based Graph Neural Network (2022.coling-1)

Copied to clipboard

Challenge: Text classification is a primary task in natural language processing (NLP).
Approach: They propose a graph neural network (HINT) that makes full use of hierarchical information contained in the text for the task of text classification.
Outcome: The proposed method outperforms the state-of-the-art methods on popular benchmarks while having a simple structure and few parameters.
HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classification (2024.eacl-long)

Copied to clipboard

Challenge: Hierarchical text classification is a complex subtask under multi-label text classification . the relevance of document sections can vary based on the hierarchy level, necessitating a dynamic document representation.
Approach: They propose a text-generation-based framework that uses language models to encode dynamic text representations.
Outcome: The proposed framework surpasses existing methods while handling data and mitigating class imbalance.
Hierarchy-Aware Global Model for Hierarchical Text Classification (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for hierarchical text classification are limited and lack holistic structural information.
Approach: They propose a hierarchy-aware global model with two variants that learn hierarchy-based label embeddings through an encoder and conduct inductive fusion of label-alike text features.
Outcome: The proposed model improves on three benchmark datasets.
Towards Better Hierarchical Text Classification with Data Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to improve hierarchical text classification are expensive and lack high-quality labeled data.
Approach: They propose a hierarchical text classification framework that can achieve both label controllability and text diversity by extracting high-quality hierarchic label information.
Outcome: The proposed method can achieve label controllability and text diversity by extracting high-quality hierarchical label information.
Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification (2022.acl-long)

Copied to clipboard

Challenge: Existing methods encode text and label hierarchy separately and mix their representations for classification, where the hierarchy remains unchanged for all input text.
Approach: They propose to embed hierarchy into a text encoder by combining input and output data to generate a hierarchy-aware representation.
Outcome: Extensive experiments on three benchmark datasets verify the effectiveness of the proposed model.
Enhancing Hierarchical Text Classification through Knowledge Graph Integration (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to hierarchical text classification are limited by lack of domain knowledge, which leads to mistakes in a variety of situations.
Approach: They propose a Knowledge-enabled Hierarchical Text Classification model which integrates knowledge graphs into HTC to address the knowledge limitations of traditional methods.
Outcome: The proposed model integrates knowledge graphs into the hierarchical text classification process, addressing the knowledge limitations of traditional methods.
Well Begun Is Half Done: An Implicitly Augmented Generative Framework with Distribution Modification for Hierarchical Text Classification (2024.lrec-main)

Copied to clipboard

Challenge: Hierarchical Text Classification (HTC) is a challenging task which aims to extract the labels in a tree structure corresponding to a given text.
Approach: They propose an explicit-agmented-generativ-e framework with distribution modification for hierarchical text classification.
Outcome: The proposed framework improves on the initial distributions of tail classes and avoids misinterpreting predictions on unbalanced data.
HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximization (2021.naacl-main)

Copied to clipboard

Challenge: Existing models for hierarchical text classification do not consider statistical constraint on label representations learned by structure encoder.
Approach: They propose a new hierarchical text classification model called HTCInfoMax which incorporates two modules to improve the model's representations.
Outcome: The proposed model can model the interaction between each text sample and its ground truth labels explicitly which filters out irrelevant information.
HIT - A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation (2021.findings-acl)

Copied to clipboard

Challenge: linguistics and morphology of resource-short code-mixed texts remain a key challenge in text processing.
Approach: They propose a hierarchical transformer-based framework that captures the semantic relationship among words and hierarchically learns sentencelevel semantics using a fused attention mechanism.
Outcome: The proposed framework improves on one European and five Indic languages on four NLP tasks on eleven datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations