Norm-based Noisy Corpora Filtering and Refurbishing in Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing noisy corpora filtering methods are insufficient to solve this problem, requiring multiple scorers trained on clean bitexts. |
| Approach: | They propose to use the information ratio from the source to the target side to distinguish unparallel sentence pairs by using norms of context vectors. |
| Outcome: | The proposed method performs comparably with state-of-the-art noisy corpora filtering techniques but is more efficient and easier to operate. |
Similar Papers
Detecting Various Types of Noise for Neural Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | a recent study investigated the impact of noise on the performance of machine translation systems. |
| Approach: | They propose to combine recent research on data filtering with original analysis . they find that most of the suggested noise types can be detected with 90% accuracy . |
| Outcome: | The proposed filtering systems can detect noise types with 90% accuracy in high resource settings. |
Learning from Noisy Labels for Entity-Centric Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent information extraction approaches can easily overfit noisy labels and suffer from performance degradation. |
| Approach: | They propose a co-regularization framework for entity-centric information extraction that optimizes neural models with task-specific losses and regularizes them to generate similar predictions based on agreement loss. |
| Outcome: | The proposed framework is optimized with task-specific losses and generates similar predictions based on agreement loss. |
How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Semantic misalignment, as the primary source of the noise, poses a challenge for training machine translation systems. |
| Approach: | They propose a process for simulating misalignment controlled by semantic similarity which closely resembles misaligned sentences in real-world web-crawled corpora. |
| Outcome: | The proposed model significantly improves translation performance in the presence of misalignment noise and when applied to real-world, noisy web-mined datasets, across a range of translation tasks. |
Noising and Denoising Natural Language: Diverse Backtranslation for Grammar Correction (N18-1)
Copied to clipboard
| Challenge: | Existing grammar correction methods are limited in their ability to correct highly local errors . evaluators are unable to distinguish noisy examples from nonsynthesized ones . |
| Approach: | They propose to synthesize parallel data by noising a clean monolingual corpus . they propose to apply noise to the corpus to syntherize additional noisy examples . |
| Outcome: | The proposed method can produce almost as strong results as training with nonsynthesized data. |
Effectively Aligning and Filtering Parallel Corpora under Sparse Data Conditions (2020.acl-srw)
Copied to clipboard
| Challenge: | Parallel corpora are key to developing good machine translation systems, but abundant parallel data is hard to come by for languages with a low number of speakers. |
| Approach: | They propose an unsupervised alignment method that can handle rich morphology by removing incorrect translations and segments containing extraneous data. |
| Outcome: | The proposed method maximizes the number of correctly translated segments in a corpus and minimises noise by removing incorrect translations and segments containing extraneous data. |
OpenSubtitles2018: Statistical Rescoring of Sentence Alignments in Large, Noisy Parallel Corpora (L18-1)
Copied to clipboard
| Challenge: | Movie and TV subtitles are a valuable resource for the compilation of parallel corpora . however, the quality of the resulting sentence alignments is often lower than for other parallel corpoora. |
| Approach: | They propose to use movie and TV subtitles to extract parallel corpora from 3.7 million subtitles spread over 60 languages to obtain explicit quality scores for each sentence alignment. |
| Outcome: | The proposed model predicts translation probabilities with a root mean square error of 0.07 . the results show that the model can prune out low-quality alignments . |
Simple and Effective Noisy Channel Modeling for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Previous work on noisy channel modeling relied on latent variable models that incrementally process the source and target sentence. |
| Approach: | They propose to use a standard sequence to sequence model which utilizes the entire source and target sentences to estimate posterior probability of a target sequence y given a source sequence x. |
| Outcome: | The proposed model outperforms direct models on German-English translations by up to 3.2 BLEU on four language pairs. |
Fixing Translation Divergences in Parallel Corpora for Neural MT (D18-1)
Copied to clipboard
| Challenge: | Existing methods to detect translation divergences from parallel corpora are noisy and limited in size. |
| Approach: | They propose an unsupervised method for detecting translation divergences in parallel sentences . they use a neural network that computes cross-lingual sentence similarity scores . |
| Outcome: | The proposed method improves translation performance for English-French and English-German translation tasks. |
Parallel Corpus Filtering via Pre-trained Language Models (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to filter out noisy parallel sentences from web crawled data are in demand. |
| Approach: | They propose a method to filter out noisy sentence pairs from web crawled corpora using pre-trained language models. |
| Outcome: | The proposed method outperforms baselines and achieves state-of-the-art on two datasets. |
Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back-Translation (D19-55)
Copied to clipboard
| Challenge: | Neural Machine Translation models are sensitive to noise in the input data. |
| Approach: | They propose new methods to extend limited noisy data and further improve NMT robustness to noise while keeping the models small. |
| Outcome: | The proposed methods extend limited noisy data and improve robustness to noise while keeping the models small. |