Rethinking Data Augmentation for Low-Resource Neural Machine Translation: A Multi-Task Learning Approach (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generating additional parallel sentences are aimed at expanding the support of the empirical data distribution by generating new sentence pairs that contain infrequent words. |
| Approach: | They propose to use data augmentation techniques to generate additional parallel sentences by reversing the order of the target sentence to produce unfluent target sentences. |
| Outcome: | The proposed approach improves on six low-resource translation tasks and the baseline and over DA methods. |
Similar Papers
Understanding Data Augmentation in Neural Machine Translation: Two Perspectives towards Generalization (D19-1)
Copied to clipboard
| Challenge: | Existing studies measure the superiority of DA methods in terms of their performance on a specific test set, but some do not exhibit consistent improvements across translation tasks. |
| Approach: | They propose to evaluate DA methods from two perspectives to determine their generalization ability . they find that DA method's test performance does not exhibit consistent improvements across translation tasks . |
| Outcome: | The proposed methods do not exhibit consistent improvements across translation tasks. |
Sentence Concatenation Approach to Data Augmentation for Neural Machine Translation (2021.naacl-srw)
Copied to clipboard
| Challenge: | Neural machine translation is known to show poor performance at long sentence translations . however, when the sentence length exceeds a certain value, the quality of NMT becomes inferior to that of statistical machine translation. |
| Approach: | They propose a method that uses given parallel corpora as train data to generate long sentences by concatenating two sentences at random. |
| Outcome: | The proposed method improves translation quality more when combined with back-translation. |
Exploring Data Augmentation for Code Generation Tasks (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have impacted how models are trained for programming language tasks. |
| Approach: | They propose to use augmentation methods that yield consistent improvements in code translation and summarization by up to 6.9% and 7.5% respectively. |
| Outcome: | The proposed methods improve translation and summarization by 6.9% and 7.5% respectively. |
DAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks (2020.emnlp-main)
Copied to clipboard
Bosheng Ding, Linlin Liu, Lidong Bing, Canasai Kruengkrai, Thien Hai Nguyen, Shafiq Joty, Luo Si, Chunyan Miao
| Challenge: | Data augmentation techniques are widely used to improve machine learning performance . however, due to the complexity of language, it is difficult to generalize such rules for languages. |
| Approach: | They propose a method to generate high quality synthetic data for low-resource tagging tasks . they use unlabeled data only and unlabelled data plus a knowledge base . |
| Outcome: | The proposed method outperforms baselines on NER, part of speech and target based sentiment analysis tasks. |
Soft Contextual Data Augmentation for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Existing methods for enhancing training data are limited in natural language tasks due to text characteristics. |
| Approach: | They propose a data augmentation method that softly augments a randomly chosen word in a sentence by its contextual mixture of multiple related words. |
| Outcome: | The proposed method outperforms baseline methods on small and large scale machine translation datasets. |
Counterfactual Data Augmentation for Neural Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | Neural machine translation models often rely on large-scale parallel corpora for training, exhibiting degraded performance on low-resource languages. |
| Approach: | They propose a method that interprets language models and phrasal alignment causally and generates augmented parallel translation corpora by sampling new source phrases from a masked language model. |
| Outcome: | The proposed method improves translation, backtranslation and translation robustness on IWSLT’15 English Vietnamese, WMT’17 English - German, and WMT'18 English – Turkish. |
Generalized Data Augmentation for Low-Resource Translation (P19-1)
Copied to clipboard
| Challenge: | Low-resource language pairs with a lack of parallel data pose challenges for machine translation . data augmentation using monolingual data is an effective way to alleviate the problem . |
| Approach: | They propose a general framework for data augmentation for low-resource machine translation using monolingual data and a related high-resourced language. |
| Outcome: | The proposed method improves translation quality by 1.5 to 8 BLEU points under extreme low-resource settings compared to baselines. |
Deterministic Reversible Data Augmentation for Neural Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent neural machine translation models have improved translation quality but they also introduce small perturbations like misspelling and paraphrasing. |
| Approach: | They propose a method that generates multi-granularity subword representations with reversible operations and deterministic segmentations. |
| Outcome: | The proposed method outperforms strong baselines on several translation tasks with a clear margin and exhibits good robustness in noisy, low-resource, and cross-domain datasets. |
Parallel Data Augmentation for Formality Style Transfer (2020.acl-main)
Copied to clipboard
| Challenge: | Formality style transfer is a task of automatically transforming text in one particular formality style into another. |
| Approach: | They propose to augment parallel data with three specific data augmentation methods to improve the model's generalization ability and reduce the overfitting risk. |
| Outcome: | The proposed methods significantly improve performance when used to pre-train the model and lead to the state-of-the-art results in the GYAFC benchmark dataset. |
Target-Side Augmentation for Document-Level Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Document-level machine translation faces the challenge of data sparsity due to its long input length and a small amount of training data. |
| Approach: | They propose a document-level machine translation model that generates many potential translations for each source document and smoothes the distribution. |
| Outcome: | The proposed method outperforms the previous best system by 2.30 s-BLEU on News and achieves new state-of-the-art on News . |