Conical Classification For Efficient One-Class Topic Determination (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a lack of research on efficient methods for topic classification of text is limiting . conical classification is a computationally efficient way to identify documents of a particular topic . |
| Approach: | They propose a Conical classification approach that can identify if a document is of a particular topic . they propose 'normal exclusion' approach that is faster to compute and has higher predictive power . |
| Outcome: | The proposed method has higher predictive power and is faster to compute. |
Similar Papers
The Strength of the Weakest Supervision: Topic Classification Using Class Labels (N19-3)
Copied to clipboard
| Challenge: | a topic classifier can understand only class labels when training for tasks that require a large amount of labeled documents. |
| Approach: | They propose an algorithm that can initialize a topic classifier using only class labels . they propose a method that combines word embedding and naive Bayes classification . |
| Outcome: | The proposed approach saves significant initial labeling effort by providing a "warm start" the proposed approach can be fine-tuned with more labeled documents to reach a certain performance level. |
Fusing Label Embedding into BERT: An Efficient Improvement for Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve text classification performance of pre-trained models have been used to improve their performance. |
| Approach: | They propose a method for improving BERT's performance by using a label embedding technique while keeping almost the same computational cost. |
| Outcome: | The proposed method improves BERT's performance on six text classification benchmark datasets while keeping almost the same computational cost. |
Efficient Classification of Long Documents Using Transformers (2022.acl-short)
Copied to clipboard
| Challenge: | Several methods have been proposed for classifying long textual documents using Transformers, but there is a lack of consensus on a benchmark to enable a fair comparison among different approaches. |
| Approach: | They propose to use a dataset to evaluate the relative efficacy of various models for long document classification using Transformers. |
| Outcome: | The proposed models outperform simple baseline models and yield inconsistent performance across datasets. |
Unsupervised Anomaly Detection in Multi-Topic Short-Text Corpora (2023.eacl-main)
Copied to clipboard
| Challenge: | Unsupervised anomaly detection is a challenging task when the majority class is heterogeneous. |
| Approach: | They propose to use word embeddings to represent each sample by a dense vector and use a Mixture Model approach to detect which samples deviate the most from the underlying distributions of the corpus. |
| Outcome: | The proposed method is more efficient than state-of-the-art methods on real datasets. |
X-Class: Text Classification with Extremely Weak Supervision (2021.naacl-main)
Copied to clipboard
| Challenge: | Weak supervision is a problem in text classification, but it requires corpusspecific knowledge. |
| Approach: | They propose a framework for extremely weak supervision that can be used to train a text classifier. |
| Outcome: | The proposed framework outperforms seed-driven weakly supervised methods on 7 benchmark datasets. |
CAST: Corpus-Aware Self-similarity Enhanced Topic modelling (2025.naacl-long)
Copied to clipboard
Yanan Ma, Chenghao Xiao, Chenhan Yuan, Sabine N Van Der Veer, Lamiece Hassan, Chenghua Lin, Goran Nenadic
| Challenge: | Existing topic modelling methods encode contextual information of documents while ignoring contextual details of candidate centroid words. Existing methods are limited by the contextualization gap. |
| Approach: | They propose a topic modelling method that builds upon candidate centroid word embeddings contextualized on the dataset and a self-similarity-based method to filter out less meaningful tokens. |
| Outcome: | The proposed method significantly enhances the coherence and diversity of generated topics, and handles noisy data, outperforming strong baselines. |
META: Metadata-Empowered Weak Supervision for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for weakly supervised text classification use text data alone to generate pseudo-labels . strong label indicators exist in metadata and it has been long overlooked due to challenges . |
| Approach: | They propose a framework that leverages metadata as an additional source of weak supervision by combining text data and metadata into a text-rich network. |
| Outcome: | The proposed framework exploits metadata as an additional source of weak supervision. |
Topic Modeling: Contextual Token Embeddings Are All You Need (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current neural approaches to topic modeling have not been able to solve all of the problems. |
| Approach: | They propose a topic modeling approach that uses document contextual token embeddings to find topics and find topic spans within documents. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on a comprehensive set of topic model evaluation metrics. |
Text2Topic: Multi-Label Text Classification System for Efficient Topic Detection in User Generated Content with Zero-Shot Capabilities (2023.emnlp-industry)
Copied to clipboard
Fengjun Wang, Moran Beladev, Ofri Kleinfeld, Elina Frayerman, Tal Shachar, Eran Fainman, Karen Lastmann Assaraf, Sarai Mizrachi, Benjamin Wang
| Challenge: | In the digital age, large-scale online travel platforms face the challenge of extracting valuable insights from massive volumes of textual data. |
| Approach: | They propose a model that uses a bi-encoder transformer architecture to extract structured information from textual data. |
| Outcome: | The proposed model outperforms state-of-the-art models with 92.9% micro mAP and 75.8% macro mA score compared to baseline models . the proposed model can be used to find hotel facilities and hotel rooms based on positive reviews . |
Self-Attentive, Multi-Context One-Class Classification for Unsupervised Anomaly Detection on Text (P19-1)
Copied to clipboard
| Challenge: | Existing methods for unsupervised anomaly detection use pre-trained word embeddings . proper text representation is critical for designing well-performing machine learning algorithms . |
| Approach: | They propose a new anomaly detection method that builds upon word embedding models to learn multiple sentence representations that capture multiple semantic contexts via the self-attention mechanism. |
| Outcome: | The proposed method performs on Reuters, 20 Newsgroups, and IMDB Movie Reviews datasets. |