Papers with IMDB
CondenseLM: LLMs-driven Text Dataset Condensation via Reward Matching (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for dataset condensation struggle to compress more information into samples . current methods struggle to extract enough training data for effective learning . |
| Approach: | They propose a paradigm for dataset condensation that uses an LLMs-driven approach to generate more informative and less biased samples. |
| Outcome: | The proposed method outperforms coreset selection and existing condensation methods by large margins while significantly reducing the computational cost. |
Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing pruning strategies struggle to enhance robustness against adversarial attacks when continually increasing model sparsity and require a retraining process. |
| Approach: | They propose a pruning strategy that replicates embedding space and feature space of dense language models and aims to conserve more pre-trained knowledge during the pruning process. |
| Outcome: | The proposed pruning strategy replicates embedding space and feature space of dense language models, aiming to conserve more pre-trained knowledge during the pruning process. |
Towards Improving Adversarial Training of NLP Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent methods for generating NLP adversarial examples involve combinatorial search and expensive sentence encoders for constraining the generated instances. |
| Approach: | They propose to use vanilla adversarial training to train NLP models using a word substitution attack optimized for vanilla adversary training. |
| Outcome: | The proposed approach improves model performance and standard accuracy and can defend against other types of word substitution attacks. |
UserAdapter: Few-Shot User Learning in Sentiment Analysis (2021.findings-acl)
Copied to clipboard
| Challenge: | Adapting a model to a handful of personalized data is challenging, authors say . standard fine-tuning requires hundreds of millions of parameters for each user . |
| Approach: | They propose a lightweight method that clamps millions of parameters of a Transformer model and optimizes a tiny user-specific vector. |
| Outcome: | The proposed method improves accuracy on Yelp and IMDB datasets and reduces the number of parameters added for each user. |
NarrowBERT: Accelerating Masked Language Model Pretraining and Inference (2023.acl-short)
Copied to clipboard
| Challenge: | Large-scale language model pretraining is expensive as the models and pretraining corpora have become larger over time. |
| Approach: | They propose a modified transformer encoder that increases throughput for masked language model pretraining by more than 2x. |
| Outcome: | The proposed model increases throughput on IMDB and Amazon reviews classification and CoNLL NER tasks by 3.5x with minimal performance degradation. |
Assessing Robustness of Text Classification through Maximal Safe Radius Computation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. |
| Approach: | They propose to provide a measure of robustness against word substitutions by computing a safe radius for a given input text. |
| Outcome: | The proposed methods are compared with LIME and CNN-Cert and show that they perform well on sentiment analysis and news classification models. |
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models’ Memories (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models demonstrate excellent abilities to understand texts in the generic domain while struggling in a specific domain. |
| Approach: | They propose to decouple the feed-forward networks of the Transformer architecture into two parts to maintain old-domain knowledge and a mixture-of-adapters gate to inject domain-specific knowledge in parallel. |
| Outcome: | The proposed method achieves superior performance on in-domain, out-of-domain and knowledge-intensive tasks. |
Learning Personas from Dialogue with Attentive Memory Networks (D18-1)
Copied to clipboard
| Challenge: | Existing systems that can infer persona from dialogue can be used for computational narrative analysis and personalized dialogue generation. |
| Approach: | They propose neural models to learn persona embeddings in a character trope classification task using IMDB dialogue snippets. |
| Outcome: | The proposed methods could be applied to other domains, including personalized dialogue generation. |
ART: Attention-Regularized Transformers for Multi-Modal Robustness (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing approaches to enhancing robustness are domain-specific or lack formal guarantees. |
| Approach: | They propose a framework that enhances robustness across modalities by regularizing attention maps under adversarial perturbations. |
| Outcome: | The proposed framework improves robustness across modalities and training on IMDB, QNLI, CIFAR-10, Cifar-100, and Imagenette. |
SAFER: A Structure-free Approach for Certified Robustness to Adversarial Word Substitutions (2020.acl-main)
Copied to clipboard
| Challenge: | State-of-the-art NLP models can be fooled by human-unaware transformations such as synonymous word substitution. |
| Approach: | They propose a method that constructs a stochastic ensemble by applying random word substitutions on the input sentences and leverages the statistical properties to provably certify the robustness. |
| Outcome: | The proposed method outperforms state-of-the-art methods on IMDB and Amazon text classification tasks with practically meaningful certified accuracy. |
Correcting Language Model Bias for Text Classification in True Zero-Shot Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Experimental results show that pre-trained language models outperform standard prompt learning in zero-shot settings. |
| Approach: | They propose a pipeline for annotating and filtering examples from unlabeled examples . they propose 'model bias validation' method that utilizes unlabed examples as validation set . |
| Outcome: | The proposed approach outperforms standard prompt learning on six text classification tasks. |
Certified Robustness to Adversarial Word Substitutions (D19-1)
Copied to clipboard
| Challenge: | State-of-the-art NLP models can be fooled by adversaries that apply seemingly innocuous label-preserving transformations to input text. |
| Approach: | They propose to train models that are provably robust to all word substitutions in a family of label-preserving transformations that can be replaced with a similar word without changing the original sentiment. |
| Outcome: | The proposed models achieve 75% adversarial accuracy on both sentiment analysis and natural language inference on IMDB and SNLI compared to models trained normally and ones trained with data augmentation. |
Continual Few-Shot Learning for Text Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | a large number of end-to-end systems are needed for many tasks in natural language processing. |
| Approach: | They propose a continual few-shot learning task where a system is asked to correct mistakes with a few training examples. |
| Outcome: | The proposed task compares two NLI and one sentiment analysis datasets with baselines from diverse paradigms. |
Speed Reading: Learning to Read ForBackward via Shuttle (D18-1)
Copied to clipboard
| Challenge: | LSTM-Shuttle uses human speed reading techniques to perform natural language processing tasks. |
| Approach: | They propose a model which uses human speed reading techniques to perform natural language processing tasks for accurate and efficient comprehension. |
| Outcome: | The proposed model predicts on IMDB, Rotten Tomatoes, AG, and Children’s Book Test datasets and goes backwards. |
Generating Fluent Adversarial Examples for Natural Languages (P19-1)
Copied to clipboard
| Challenge: | Current methods for building adversarial attackers for NLP are inefficient as the gradient is discarded. |
| Approach: | They propose an adversarial attacker which performs Metropolis-Hastings sampling with the guidance of gradients to solve these problems. |
| Outcome: | The proposed algorithm outperforms the baseline model on attacking capability on IMDB and SNLI. |
Improving Document-Level Sentiment Analysis with User and Product Context (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work that improves document-level sentiment analysis by encoding user and product information has been limited to considering only the text of the current review. |
| Approach: | They propose to incorporate all available historical review text belonging to the author of the review in question and investigate the inclusion of his- torical reviews associated with the current product. |
| Outcome: | The proposed model improves on IMDB, Yelp 2013 and Yelpan 2014 datasets by more than 2 percentage points in the best case. |
Detecting Label Errors by Using Pre-Trained Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for label error detection focus on label errors in training data. |
| Approach: | They propose a method for introducing realistic, human-originated label noise into existing crowdsourced datasets such as SNLI and TweetNLP. |
| Outcome: | The proposed method outperforms existing methods for detecting label errors in natural language datasets. |
Textual Dataset Distillation via Language Model Embedding (2024.findings-emnlp)
Copied to clipboard
| Challenge: | prevailing methods for dataset distillation generate distilled data as embedding vectors, which are not human-readable. |
| Approach: | They propose a model-agnostic, data-efficient method that leverages Language Model embeddings . their method offers enhanced flexibility and improved transferability . |
| Outcome: | The proposed method achieves comparable performance with faster processing times compared to other methods . it offers enhanced flexibility and improved transferability, expanding the range of potential applications . |
CURE: Controlled Unlearning for Robust Embeddings — Mitigating Conceptual Shortcuts in Pre-Trained Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models are susceptible to spurious, concept-driven correlations that impair robustness and fairness. |
| Approach: | They propose a framework that disentangles and suppresses conceptual shortcuts while preserving essential content information. |
| Outcome: | The proposed framework improves on IMDB and Yelp datasets with minimal computational overhead. |
Domain Generalization via Switch Knowledge Distillation for Robust Review Representation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for review representations of unseen or anonymous users are limited by their in-domain nature. |
| Approach: | They propose to use in-domain user and product information to generalize reviews . they use switch knowledge distillation to learn review representations for unseen users . |
| Outcome: | The proposed model performs well for existing or anonymous unseen users. |