| Challenge: | Existing hierarchical classification models are unable to handle large corpora and the number of categories increases with increasing corpus. |
| Approach: | They propose to use external knowledge to introduce a hierarchical neural attention-based classifier to help with the classification of documents. |
| Outcome: | The proposed model performs better than or comparable to state-of-the-art hierarchical models at significantly lower computational cost while maintaining high interpretability. |
Similar Papers
Efficient Strategies for Hierarchical Text Classification: External Knowledge and Auxiliary Tasks (2020.acl-main)
Copied to clipboard
| Challenge: | Hierarchical text classification is a complex task that requires extended training time and a large number of parameters. |
| Approach: | They propose a top-up-classification task using dictionaries and auxiliary task from external dictionary definitions. |
| Outcome: | The proposed method outperforms previous studies using a reduced number of parameters in two well-known English datasets. |
Neural Attention-Aware Hierarchical Topic Model (2021.emnlp-main)
Copied to clipboard
| Challenge: | Neural topic models (NTMs) use deep neural networks to learn topic information. |
| Approach: | They propose a variational autoencoder model that reconstructs sentence and document word counts using bag-of-words embeddings and pre-trained semantic embedders. |
| Outcome: | The proposed model lowers reconstruction errors at sentence and document levels and finds more coherent topics from real-world datasets. |
A Novel Perspective to Look At Attention: Bi-level Attention-based Explainable Topic Modeling for News Classification (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing deep learning models have the attention mechanism to improve performance, but the inherent characteristics of deep learning model complexity and the flexibility of the attention structure make them difficult to explain. |
| Approach: | They propose a two-tier attention architecture to decouple the complexity of explanation and the decision-making process by using large-scale news corpora. |
| Outcome: | The proposed model can achieve competitive performance with state-of-the-art models and illustrates its appropriateness from an explainability perspective. |
NeuralClassifier: An Open-source Neural Hierarchical Multi-label Text Classification Toolkit (P19-3)
Copied to clipboard
| Challenge: | NeuralClassifier is a toolkit for hierarchical multi-label text classification. |
| Approach: | They propose a toolkit for neural hierarchical multi-label text classification . they use a variety of text encoders to implement the model . |
| Outcome: | The proposed model achieves comparable performance with reported results in the literature. |
Hierarchical Attention Prototypical Networks for Few-Shot Text Classification (D19-1)
Copied to clipboard
| Challenge: | Existing methods for text classification are based on large-scale labeled data, but few data are available. |
| Approach: | They propose a hierarchical attention prototypical networks for few-shot text classification . they use attention mechanism to highlight or weaken the importance of features, words, and instances . |
| Outcome: | The proposed model can capture more important features, words, and instances . it can also increase support set augmentability and accelerate convergence speed in training stage . |
Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)
Copied to clipboard
| Challenge: | Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved. |
| Approach: | They propose to use different types of model architectures to improve extractive summarization systems. |
| Outcome: | The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis. |
Improving Context Modeling in Neural Topic Segmentation (2020.aacl-main)
Copied to clipboard
| Challenge: | Recent work favors highly effective neural supervised approaches for topic segmentation but current neural solutions are limited in how they model context. |
| Approach: | They propose to enhance a hierarchical attention biLSTM network-based topic segmenter to better model context by adding a coherence-related auxiliary task and restricted self-attention. |
| Outcome: | The proposed model outperforms SOTA approaches on three datasets and on four real-world benchmarks. |
Generating Hierarchical Explanations on Text Classification via Feature Interaction Detection (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for generating explanations for neural networks ignore feature interactions between words and phrases. |
| Approach: | They propose to build hierarchical explanations by detecting feature interactions by combining words and phrases at different levels of the hierarchy. |
| Outcome: | The proposed method is evaluated on two benchmark datasets, via automatic and human evaluations. |
HFT-CNN: Learning Hierarchical Category Structure for Multi-label Short Text Categorization (D18-1)
Copied to clipboard
| Challenge: | Existing methods for categorization of short texts use non-hierarchical flat model, but they are limited by domain-independent knowledge distribution. |
| Approach: | They propose a method which leverages hierarchical relationships between pre-defined categories to tackle the data sparsity problem. |
| Outcome: | The proposed method is competitive with the state-of-the-art methods on a multi-label categorization task for short texts using two benchmark datasets. |
Deep Attention Diffusion Graph Neural Networks for Text Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text classification based on graph neural networks (GNNs) consider only one-hop neighborhoods and low-frequency information within texts, which suffer from over-smoothing issues if many graph layers are stacked. |
| Approach: | They propose a deep attention diffusion Graph Neural Network model to learn text representations by bridging the chasm of interaction difficulties between a word and its distant neighbors. |
| Outcome: | The proposed model outperforms existing methods on standard benchmark datasets on a set of textual features. |