Challenge: Existing text classification frameworks for operational risk prediction lack interpretability and labeled data are often misaligned.
Approach: They propose a semi-supervised text classification framework that integrates multi-head attention mechanism with Semi-supervised variational inference for operational risk classification.
Outcome: The proposed framework outperforms baseline methods on a real-world dataset and can use unlabeled data to learn visually interpretable representations.

Similar Papers

Variational Pretraining for Semi-supervised Text Classification (P19-1)

Copied to clipboard

Challenge: Empirically, we show the relative strength of VAMPIRE against computationally expensive contextual embeddings and other popular semi-supervised baselines under low resource settings.
Approach: They propose a lightweight framework for effective text classification when data and computing resources are limited.
Outcome: The proposed framework is compared with expensive contextual embeddings and semi-supervised baselines under low resource settings.
STINMatch: Semi-Supervised Semantic-Topological Iteration Network for Financial Risk Detection via News Label Diffusion (2023.emnlp-main)

Copied to clipboard

Challenge: Commercial news provides rich semantics and timely information for automated financial risk detection.
Approach: They propose a semi-supervised Semantic-Topological Iteration Network, STINMatch, along with a news-enterprise knowledge graph to endorse the risk detection enhancement.
Outcome: The proposed model outperforms existing models in terms of generalization and semantics and annotation.
Variational Sequential Labelers for Semi-Supervised Learning (D18-1)

Copied to clipboard

Challenge: a family of multitask variational methods for semi-supervised sequence labeling is currently unclear how to use them in the context of sequence labelling.
Approach: They propose a family of multitask variational methods for semi-supervised sequence labeling using latent variables and a discriminative labeler.
Outcome: The proposed models outperform standard sequential baselines on 8 sequence labeling datasets and improve further with unlabeled data.
Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classification (2021.eacl-main)

Copied to clipboard

Challenge: Semi-supervised learning and multilingual pretraining have been shown to be effective for task-specific labelled data shortages.
Approach: They propose to combine semi-supervised deep generative models and multi-lingual pretraining to form a pipeline for document classification task.
Outcome: The proposed method outperforms state-of-the-art models in low-resource settings across several languages and outperformed existing models in English.
DocFin: Multimodal Financial Prediction and Bias Mitigation using Semi-structured Documents (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing research focuses on textual and audio modalities of financial disclosures but ignores the rich tabular data available in financial reports.
Approach: They propose to combine tabular financial data with text transcripts and audio recordings to improve stock volatility and price movement prediction by 5-12% and reduce gender bias by over 30%.
Outcome: The combined data improves stock volatility and price movement prediction by 5-12% and reduces gender bias caused due to audio-based neural networks by over 30%.
Framing Unpacked: A Semi-Supervised Interpretable Multi-View Model of Media Frames (2021.naacl-main)

Copied to clipboard

Challenge: Existing models for news analysis lack transparency in their predictions.
Approach: They propose a semi-supervised model that embeds local information into news articles . it can be used to improve automatic news analysis, authors argue .
Outcome: The proposed model outperforms previous models and can be used with unlabeled training data.
Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for improving model interpretability require prior information or human annotations as additional inputs.
Approach: They propose a variational word mask method to automatically learn task-specific important words and reduce irrelevant information on classification, which ultimately improves model interpretability.
Outcome: The proposed method improves model prediction accuracy and interpretability on seven datasets.
Rank-Aware Negative Training for Semi-Supervised Text Classification (2023.tacl-1)

Copied to clipboard

Challenge: Semi-supervised text classification-based paradigms employ the spirit of self-training, but the accuracy of pseudo-labels can be a problem in real-world scenarios.
Approach: They propose a Rank-aware Negative Training framework to address SSTC in noisy label learning . they rank unlabeled texts based on evidential support from the labeled texts.
Outcome: The proposed framework overcomes state-of-the-art alternatives and achieves competitive performance in other scenarios.
JointMatch: A Unified Approach for Diverse and Collaborative Pseudo-Labeling to Semi-Supervised Text Classification (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to semi-supervised text classification suffer from pseudo-label bias and error accumulation.
Approach: They propose a pseudo-labeling approach to semi-supervised text classification that unifies ideas from semi-semi-supervised learning and the task of learning with noise.
Outcome: The proposed approach achieves a significant improvement on benchmark datasets even in the extremely-scarce-label setting.
Semi-Supervised Text Classification with Balanced Deep Representation Distributions (2021.acl-long)

Copied to clipboard

Challenge: Semi-Supervised Text Classification (SSTC) is a type of self-training that uses labeled and unlabeled data to perform certain applications.
Approach: They propose a method to initialize a deep classifier by training over labeled texts . they then alternatively predict unlabeled texts as their pseudo-labels and train them over the mixture .
Outcome: Empirical results show that the proposed method is more accurate when labeled texts are scarce.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations