Papers with denoising
Advances and Challenges in Unsupervised Neural Machine Translation (2021.eacl-tutorials)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (UNMT) has achieved impressive results, but there are still several challenges for the technology. |
| Approach: | They present a framework for unsupervised neural machine translation (UNMT) they examine the latest progress and challenges of UNMT and examine how it holds up . |
| Outcome: | The proposed method has achieved impressive results but still faces challenges. |
Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing non-autoregressive (NAR) text-to-text generation methods are unable to generate coherent and fluent texts due to discrete nature of text. |
| Approach: | They propose to integrate discrete diffusion models (DDM) into NAR text-to-text generation and integrate BART to improve the performance. |
| Outcome: | The proposed method outperforms competing methods and surpasses autoregressive methods on 7 datasets. |
Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Unsupervised bilingual word embedding (UBWE) has helped unsupervised neural machine translation (UNMT) achieve remarkable results in several language pairs. |
| Approach: | They propose two methods that train UNMT with UBWE agreement . they propose to use UBwe to initialize word embedding in UNMT . |
| Outcome: | The proposed methods outperform conventional methods on several language pairs. |
Zero-Shot and Few-Shot Stance Detection on Varied Topics via Conditional Generation (2023.acl-short)
Copied to clipboard
| Challenge: | Existing work on stance detection focuses on in-domain or leave-out targets with only a few target choices. |
| Approach: | They propose to use a conditional generation framework to denoise from partially-filled templates to better utilize the semantics among input, label, and target texts. |
| Outcome: | The proposed method significantly outperforms strong baselines on VAST and achieves new state-of-the-art performance. |
t-HNE: A Text-guided Hierarchical Noise Eliminator for Multimodal Sentiment Analysis (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal sentiment analysis assume that all modalities contribute equally to model performance. |
| Approach: | They propose a text-guided Hierarchical Noise Eliminator model that extracts modality-consistent information from unimodal data and integrates it into multimodal representations for sentiment classification. |
| Outcome: | The proposed model reduces noise caused by modality inconsistency by maximizing mutual information between textual representations and visual and acoustic representations. |
CETA: A Consensus Enhanced Training Approach for Denoising in Distantly Supervised Relation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction use noisy instances and poor quality training data. |
| Approach: | They propose a sentence-level DSRE method that denies noisy samples from the wrong classification space on the feature space by enhancing the classification consensus between two discrepant classifiers. |
| Outcome: | The proposed method outperforms existing methods on widely-used benchmarks and significantly outperformed existing methods. |
Unsupervised Neural Text Simplification (P19-1)
Copied to clipboard
| Challenge: | Existing unsupervised methods for text simplification are limited to unlabeled text . paper aims to improve the performance of unsupervised systems by incorporating labeled pairs . |
| Approach: | They propose to use unlabeled text to train a neural text simplification framework . they propose to add a pair of attentional-decoders to the framework to improve performance . |
| Outcome: | The proposed model outperforms existing supervised methods on public test data. |
DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing generative masked language models have a shared training objective, i.e., denoising. |
| Approach: | They propose a noise schedule for the forward diffusion process that controls the degree of noise added at each step based on the information of each token. |
| Outcome: | The proposed model improves on existing models in terms of perplexity and BLEU score. |
F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching (2025.acl-long)
Copied to clipboard
| Challenge: | Recent research in Text-to-Speech (TTS) has experienced great advancement . current models can synthesize speech for any given text and mimic the speaker of audio prompt. |
| Approach: | They propose a fully non-autoregressive text-to-speech system based on flow matching with Diffusion Transformer (DiT) without complex designs such as duration model, text encoder, and phoneme alignment, the text input is simply padded with filler tokens to the same length as input speech, and then denoising is performed for speech generation. |
| Outcome: | The proposed system achieves an inference RTF of 0.15, which is greatly improved compared to state-of-the-art diffusion-based models. |
CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to named entity recognition (NER) are limited by the cost of labeling and labeling, especially for low-resource languages. |
| Approach: | They propose a model-collaboration-based denoising scheme that enables models trained on different data sources to collaboratively denoise pseudo labels used by each other. |
| Outcome: | The proposed framework achieves superior results on benchmark datasets and can generalize to distant languages. |
DiffuseDef: Improved Robustness to Adversarial Attacks via Iterative Denoising (2025.acl-long)
Copied to clipboard
| Challenge: | Existing adversarial defense methods for natural language processing still pose challenges to adversarials. |
| Approach: | They propose a novel adversarial defense method that incorporates a diffusion layer as a denoiser between the encoder and the classifier. |
| Outcome: | The proposed method improves over existing adversarial defense methods and achieves state-of-the-art performance against black-box and white-box adversarials. |
CreditDecoding: Accelerating Parallel Decoding in Diffusion Large Language Models with Trace Credit (2026.acl-long)
Copied to clipboard
| Challenge: | Diffusion large language models generate text through iterative denoising with bidirectional attention, enabling richer contextual dependencies. |
| Approach: | They propose a training-free parallel decoding method that fuses Trace Credit with current logits to boost the confidence of correct but underconfident tokens. |
| Outcome: | The proposed method achieves 5.48 times speedup with +0.48 accuracy on LLaDA-8B and is orthogonal to mainstream inference optimizations. |
M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing work mainly utilizes image information to improve the performance of MABSA task. |
| Approach: | They propose a multimodal Aspect-based Sentiment Analysis task that uses image information to improve model performance. |
| Outcome: | The proposed framework outperforms state-of-the-art work on three sub-tasks of MABSA. |
Hide and Seek in Noise Labels: Noise-Robust Collaborative Active Learning with LLMs-Powered Assistance (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for learning from noisy labels are difficult to improve . existing methods identify noisy labels and use active learning to query experts . |
| Approach: | They propose a collaborative learning framework to combine LLMs and small models for learning from noisy labels. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines on synthetic and real-world noise datasets. |
DaNet: Dual-Aware Enhanced Alignment Network for Multimodal Aspect-Based Sentiment Analysis (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods assume a direct alignment between images and aspects, matching the entire image with a corresponding aspect. Existing algorithms assume 'direct alignment' between images, introducing noise. |
| Approach: | They propose a Dual-Aware Enhanced Alignment Network (DaNet) that can enhance fine-grained multimodal aspect-image alignment and denoising. |
| Outcome: | The proposed system outperforms existing methods in three subtasks and is available on https://github.com/***/DaNet. |
Instance Regularization for Discriminative Language Model Pre-training (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have optimized independent strategies of ennoising or denosing . Existing methods treat training instances equally throughout the training process . |
| Approach: | They propose to use ennoising and denoising to train discriminative pre-trained language models . they propose to model the complexity of restoring the original sentences from corrupted ones . |
| Outcome: | Experimental results show that the proposed method improves pre-training efficiency, effectiveness, and robustness. |
Identifying Noise in Human-Created Datasets using Training Dynamics from Generative Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing noise detection techniques for autoencoder models do not generalize to ArLMs due to differences in learning dynamics. |
| Approach: | They propose a method that leverages training dynamics to rank datapoints from easy-to-learn to hard-tolear . TDRanker achieves at least 2x faster denoising than previous techniques . |
| Outcome: | The proposed method demonstrates robustness across multiple model architectures and noise levels. |
Unifying Discrete and Continuous Representations for Unsupervised Paraphrase Generation (2023.emnlp-main)
Copied to clipboard
Mingfeng Xue, Dayiheng Liu, Wenqiang Lei, Jie Fu, Jian Lan, Mei Li, Baosong Yang, Jun Xie, Yidan Zhang, Dezhong Peng, Jiancheng Lv
| Challenge: | Existing unsupervised paraphrase generation methods require large-scale, manually annotated paraphrase datasets, which are labor-intensive to build. |
| Approach: | They propose a self-supervised pseudo-data construction method that generates diverse pseudo-paraphrases in distinct surface structures for a given sentence. |
| Outcome: | The proposed method generates diverse pseudo-paraphrases in distinct surface structures for a given sentence. |
Learning on Imbalanced Noisy Data via Debiased Sample Selection and LLM-Driven Annotation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to learning with noisy labels are prone to selection bias and training bias . obtaining large-scale high-quality datasets is expensive and time-consuming in practical scenarios . |
| Approach: | They propose an imbalanced learning with noisy labels task to let model learn from noisy labels . they first conduct debiased sample selection to better separate clean samples from noisy samples . then they feed selected clean samples to active annotator large language models for re-annotating noisy samples. |
| Outcome: | The proposed method is superior to existing methods on synthetic and real-world datasets. |