SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Existing methods for data augmentation for text-based tasks such as machine translation are limited due to noise and noise. |
| Approach: | They propose a data augmentation policy with desirable properties as an optimization problem and propose 'SwitchOut' switchout randomly replaces words in both the source and target sentences with other random words from their corresponding vocabularies. |
| Outcome: | The proposed method outperforms strong alternatives such as word dropout on three translation datasets. |
Similar Papers
Soft Contextual Data Augmentation for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Existing methods for enhancing training data are limited in natural language tasks due to text characteristics. |
| Approach: | They propose a data augmentation method that softly augments a randomly chosen word in a sentence by its contextual mixture of multiple related words. |
| Outcome: | The proposed method outperforms baseline methods on small and large scale machine translation datasets. |
Neural Fuzzy Repair: Integrating Fuzzy Matches into Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Several configurations are tested on the DGT-TM data set for the language directions English into Dutch (ENNL) and English into Hungarian (ENHU). |
| Approach: | They propose and test two methods for augmenting NMT training data with fuzzy TM matches by concatenation. |
| Outcome: | The proposed method improves on the DGT-TM data set for two language pairs and is easy to implement. |
Code-Switching for Enhancing NMT with Pre-Specified Translation (N19-1)
Copied to clipboard
| Challenge: | Existing methods to constrain NMT use placeholder tags for lexicon words and hard constraints during decoding. |
| Approach: | They propose to use placeholder tags to replace lexicon words with target translations . they use a data augmentation method to make code-switched training data . |
| Outcome: | The proposed method improves translation quality without hurting unconstrained words. |
Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Code-switching (CSW) text generation is a popular solution to address data scarcity. |
| Approach: | They compare linguistic theories, lexical replacements and back-translation approaches to Egyptian Arabic-English CSW. |
| Outcome: | The proposed methods perform best on machine translation and quality evaluation. |
Deterministic Reversible Data Augmentation for Neural Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent neural machine translation models have improved translation quality but they also introduce small perturbations like misspelling and paraphrasing. |
| Approach: | They propose a method that generates multi-granularity subword representations with reversible operations and deterministic segmentations. |
| Outcome: | The proposed method outperforms strong baselines on several translation tasks with a clear margin and exhibits good robustness in noisy, low-resource, and cross-domain datasets. |
Understanding Data Augmentation in Neural Machine Translation: Two Perspectives towards Generalization (D19-1)
Copied to clipboard
| Challenge: | Existing studies measure the superiority of DA methods in terms of their performance on a specific test set, but some do not exhibit consistent improvements across translation tasks. |
| Approach: | They propose to evaluate DA methods from two perspectives to determine their generalization ability . they find that DA method's test performance does not exhibit consistent improvements across translation tasks . |
| Outcome: | The proposed methods do not exhibit consistent improvements across translation tasks. |
Pluggable Neural Machine Translation Models via Memory-augmented Adapters (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent years, neural machine translation systems are often developed with large-scale parallel data extracted from the Web. |
| Approach: | They propose a memory-augmented adapter to steer pretrained neural machine translation models in a pluggable manner by combining model representations and retrieved results. |
| Outcome: | The proposed method outperforms several representative pluggable baselines on style- and domain-specific experiments. |
Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back-Translation (D19-55)
Copied to clipboard
| Challenge: | Neural Machine Translation models are sensitive to noise in the input data. |
| Approach: | They propose new methods to extend limited noisy data and further improve NMT robustness to noise while keeping the models small. |
| Outcome: | The proposed methods extend limited noisy data and improve robustness to noise while keeping the models small. |
A Simple and Effective Approach to Coverage-Aware Neural Machine Translation (P18-2)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) models are used to solve translation problems using long-term models. |
| Approach: | They propose a method to seek a better balance between model confidence and length preference for Neural Machine Translation. |
| Outcome: | The proposed model improves on Chinese-English and English-German translation tasks. |
Token Drop mechanism for Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Neural machine translation models are vulnerable to unfamiliar inputs. |
| Approach: | They propose to drop tokens of the input sentences to improve generalization and avoid overfitting for the NMT model. |
| Outcome: | The proposed approach improves on Chinese-English and English-Romanian benchmarks and achieves significant performance improvements over baselines. |