Text2Topic: Multi-Label Text Classification System for Efficient Topic Detection in User Generated Content with Zero-Shot Capabilities (2023.emnlp-industry)
Copied to clipboard
Fengjun Wang, Moran Beladev, Ofri Kleinfeld, Elina Frayerman, Tal Shachar, Eran Fainman, Karen Lastmann Assaraf, Sarai Mizrachi, Benjamin Wang
| Challenge: | In the digital age, large-scale online travel platforms face the challenge of extracting valuable insights from massive volumes of textual data. |
| Approach: | They propose a model that uses a bi-encoder transformer architecture to extract structured information from textual data. |
| Outcome: | The proposed model outperforms state-of-the-art models with 92.9% micro mAP and 75.8% macro mA score compared to baseline models . the proposed model can be used to find hotel facilities and hotel rooms based on positive reviews . |
Similar Papers
Label-semantics Aware Generative Approach for Domain-Agnostic Multilabel Classification (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multi-label text classification are limited by textual data. |
| Approach: | They propose a domain-agnostic generative model framework for multi-label text classification that generates predefined label descriptions and matches them to predefined labels. |
| Outcome: | The proposed model achieves 13.94% and 24.85% performance over all datasets. |
Enhancing Extreme Multi-Label Text Classification: Addressing Challenges in Model, Data, and Evaluation (2023.emnlp-industry)
Copied to clipboard
Dan Li, Zi Long Zhu, Janneke van de Loo, Agnes Masip Gomez, Vikrant Yadav, Georgios Tsatsaronis, Zubair Afzal
| Challenge: | Existing approaches to extreme multi-label text classification face inherent challenges in terms of model, data, and evaluation. |
| Approach: | They propose a label ranking model as an alternative to the conventional SciBERT-based classification model and an active learning-based pipeline that addresses the data scarcity of new labels during the update of a classification system. |
| Outcome: | The proposed model enables efficient handling of large-scale labels and accommodates new labels. |
Zero-Shot Multi-Label Topic Inference with Sentence Encoders and LLMs (2023.emnlp-main)
Copied to clipboard
| Challenge: | In this paper, we focus on Zero-shot approaches for inferring topics from documents where both the document and topics were never seen by a model previously. |
| Approach: | They propose to use Sentence Encoders and Large Language Models to perform a "definition-wild zero-shot topic inference" where users define or provide topics of interest in real-time. |
| Outcome: | The proposed methods outperform ChatGPT-3.5 and PaLM and Sentence-BERT on the definition-wild zero-shot topic inference task on seven datasets. |
Large-Scale Multi-Label Text Classification on EU Legislation (P19-1)
Copied to clipboard
| Challenge: | Large-Scale multi-label text classification is a task of assigning to each document all the relevant labels from a large set, typically containing thousands of labels (classes). |
| Approach: | They propose to use a dataset of 57k English EU legislative documents annotated with 4.3k EUROVOC labels for LMTC, few-shot learning and contextual embeddings. |
| Outcome: | The proposed dataset is suitable for LMTC, few- and zero-shot learning and bypasses the maximum text length limit. |
Beyond Text: Incorporating Metadata and Label Structure for Multi-Label Document Classification using Heterogeneous Graphs (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for multi-label document classification ignore the heterogeneous graphical structures of metadata and labels. |
| Approach: | They propose a neural network based approach to multi-label document classification that uses two heterogeneous graphs to model metadata and labels. |
| Outcome: | The proposed approach outperforms state-of-the-art models on two benchmark datasets. |
Scalable and Cost Effective High-Cardinality Classification with LLMs via Multi-View Label Representations and Retrieval Augmentation (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for labeling contact center interactions show significant inconsistencies and sensitivity to label ordering. |
| Approach: | They propose a two-step retrieval-augmented classification framework enhanced with a multi-view representation of labels. |
| Outcome: | The proposed method significantly improves accuracy and consistency over baseline methods. |
Structural Contrastive Representation Learning for Zero-shot Multi-label Text Classification (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for zero-shot multi-label text classification struggle with accuracy and poor training efficiency. |
| Approach: | They propose a structural contrastive representation learning approach that uses randomized text segmentation to generate high-quality contrastive pairs. |
| Outcome: | The proposed approach improves accuracy and speed up training time on publicly available datasets. |
Zero-shot prompt-based classification: topic labeling in times of foundation models in German Tweets (2025.acl-srw)
Copied to clipboard
| Challenge: | Recent advances in NLP have enabled the use of text-to-text annotation without providing training samples. |
| Approach: | They propose a text-to-text interface for automatic annotation using written guidelines without providing training samples. |
| Outcome: | The proposed approach is comparable with the fine-tuned BERT but without any training data. |
Open-world Multi-label Text Classification with Extremely Weak Supervision (2024.emnlp-main)
Copied to clipboard
| Challenge: | Similar single-label XWS settings cannot be easily adapted for multi-l label classification. |
| Approach: | They propose a novel method for open-world multi-label text classification under extremely weak supervision where the user provides a brief description without any labels or ground-truth label space. |
| Outcome: | The proposed method exhibits a remarkable increase in ground-truth label space coverage on various datasets. |
Extreme Zero-Shot Learning for Extreme Text Classification (2022.naacl-main)
Copied to clipboard
| Challenge: | Experimental results show that MACLR achieves superior performance compared to other baseline methods. |
| Approach: | They propose to pre-train Transformer-based encoders with self-supervised contrastive losses to learn the semantic embeddings of instances and labels with raw text. |
| Outcome: | The proposed method improves on the EZ-XMC model with a limited number of ground-truth positive pairs. |