ConvTextTM: An Explainable Convolutional Tsetlin Machine Framework for Text Classification

Challenge:	Recent advances in natural language processing (NLP) have reshaped the industry . complexity of such models makes them a “black box” and can cause ethical concerns .
Approach:	They propose a convolutional TM architecture that breaks down text into a sequence of fragments . they propose to use a tokenization scheme to bind the tokens to the text fragments.
Outcome:	The proposed architecture improves on a set of text fragments and eliminates the need for a corpus-specific vocabulary.

Similar Papers

Overview

Challenge

Approach

Outcome

LLM-Guided Semantic Bootstrapping for Interpretable Text Classification with Tsetlin Machines (2026.findings-acl)

Copied to clipboard

Jiechao Gao, Rohan Kumar Yadav, Yuangang Li, Yuandong Pan, Jie Wang, Ying Liu, Michael Lepech

Explainability & Interpretability in NLP

Challenge:	Pretrained language models (PLMs) provide strong semantic representations but are costly and opaque.
Approach:	They propose a framework that transfers pretrained language models into symbolic form and integrates them into symbolic models.
Outcome:	The proposed framework improves interpretability and accuracy across multiple text classification tasks while remaining fully symbolic and efficient.

Token Prediction as Implicit Classification to Identify LLM-Generated Text (2023.emnlp-main)

Copied to clipboard

Yutian Chen, Hao Kang, Vivian Zhai, Liangze Li, Rita Singh, Bhiksha Raj

Text Classification

Challenge:	a novel approach for identifying large language models (LLMs) involved in text generation is proposed . instead of adding an additional classification layer, we reframe the classification task as a next-token prediction task .
Approach:	They propose a novel approach for identifying large language models involved in text generation . instead of adding an additional classification layer, they reframe the task as a next-token prediction task .
Outcome:	The proposed method performs exceptionally well in the text classification task . it can distinguish distinctive writing styles among various LLMs even without an explicit classifier.

SELFEXPLAIN: A Self-Explaining Architecture for Neural Text Classifiers (2021.emnlp-main)

Copied to clipboard

Dheeraj Rajagopal, Vidhisha Balachandran, Eduard H Hovy, Yulia Tsvetkov

Explainability & Interpretability in NLP

Challenge:	Existing models that explain text classification predictions are opaque and overfit to spurious artifacts.
Approach:	They propose a novel self-explaining model that explains a text classifier’s predictions using phrase-based concepts.
Outcome:	The proposed model shows that it is adequate, trustworthy and understandable by human judges compared to existing baselines.

Interpretable Text Embeddings and Text Similarity Explanation: A Survey (2025.emnlp-main)

Copied to clipboard

Juri Opitz, Lucas Moeller, Andrianos Michail, Sebastian Padó, Simon Clematide

Explainability & Interpretability in NLP

Challenge:	Text embeddings are a fundamental component in many NLP tasks, but their interpretation and explanation remain challenging.
Approach:	They propose a framework for interpretable text embeddings and text similarity explanation . they characterize the main ideas, approaches, and trade-offs and discuss lessons learned .
Outcome:	The proposed methods are compared with existing models and compare them with existing ones.

Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification (D18-1)

Copied to clipboard

Junyang Lin, Qi Su, Pengcheng Yang, Shuming Ma, Xu Sun

Information Extraction & Text Mining

Challenge:	a novel model for multi-label text classification is proposed for the task of assigning multiple labels for a given text.
Approach:	They propose a novel model for multi-label text classification based on sequence-to-sequence learning and a hybrid attention mechanism that extracts both the word-level and the semantic unit.
Outcome:	The proposed model is competitive to the baseline models and more robust to classifying low-frequency labels.

Towards Explainable NLP: A Generative Explanation Framework for Text Classification (P19-1)

Copied to clipboard

Hui Liu, Qingyu Yin, William Yang Wang

Explainability & Interpretability in NLP

Challenge:	Existing approaches for explainable machine learning systems focus on interpreting outputs or connections between inputs and outputs.
Approach:	They propose a generative explanation framework that learns to make classification decisions and generates fine-grained explanations at the same time.
Outcome:	The proposed framework surpasses all baselines on two datasets and generates concise explanations at the same time.

Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networks (N18-2)

Copied to clipboard

Diego Marcheggiani, Jasmijn Bastings, Ivan Titov

Multilinguality

Challenge:	Semantic representations have long been argued as potentially useful for enforcing meaning preservation and improving generalization performance of machine translation methods.
Approach:	They propose to integrate semantic representations into neural machine translation by injecting a semantic bias into sentence encoders and achieving improvements in BLEU scores.
Outcome:	The proposed representations achieve better BLEU scores over the linguistic-agnostic and syntax-aware versions on the English–German language pair.

ProtT3: Protein-to-Text Generation for Text-based Protein Understanding (2024.acl-long)

Copied to clipboard

Zhiyuan Liu, An Zhang, Hao Fei, Enzhi Zhang, Xiang Wang, Kenji Kawaguchi, Tat-Seng Chua

Semantic Text Processing

Challenge:	Language Models excel in understanding textual descriptions of proteins, but struggle to process texts.
Approach:	They propose a framework for Protein-to-Text Generation for Text-based Protein Understanding that integrates a PLM as its protein understanding module.
Outcome:	The proposed framework surpasses existing baselines and is highly efficient in protein-to-text generation.

Rethinking Text-based Protein Understanding: Retrieval or LLM? (2025.emnlp-main)

Copied to clipboard

Juntong Wu, Zijing Liu, He Cao, Li Hao, Bin Feng, Zishan Shu, Ke Yu, Li Yuan, Yu Li

Information Retrieval

Challenge:	Recent studies have focused on integrating protein-related knowledge into large language models through continued pretraining and multi-modal alignment.
Approach:	They propose a retrieval-enhanced method which significantly outperforms fine-tuned LLMs for protein-to-text generation and shows accuracy and efficiency in training-free scenarios.
Outcome:	The proposed method significantly outperforms fine-tuned LLMs for protein-to-text generation and shows accuracy and efficiency in training-free scenarios.

Task-Aware Representation of Sentences for Generic Text Classification (2020.coling-main)

Copied to clipboard

Kishaloy Halder, Alan Akbik, Josip Krapac, Roland Vollgraf

Semantic Text Processing

Challenge:	Existing approaches to text classification use a transformer architecture with a linear layer on top.
Approach:	They propose a transformer-based approach that outputs a class distribution for a given prediction problem.
Outcome:	The proposed model outperforms existing approaches on small training data and can learn to predict new classes even with no training examples.