A Natural Diet: Towards Improving Naturalness of Machine Translation Output (2022.findings-acl)
Copied to clipboard
| Challenge: | MT evaluation often focuses on accuracy and fluency without paying much attention to translation style. |
| Approach: | They propose a method for training machine translation systems to achieve a more natural style by contrasting training data according to the naturalness of the target side. |
| Outcome: | The proposed method achieves lexical richness on par with human translations, and is preferred by human experts when compared to baseline translations. |
Similar Papers
Revisiting Machine Translation for Cross-lingual Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work in cross-lingual learning has pivoted around multilingual models, which are typically pretrained on unlabeled corpora in multiple languages using some form of language modeling objective. |
| Approach: | They propose to use a stronger machine translation system to mitigat mismatch between training on original text and running inference on machine translated text. |
| Outcome: | The proposed approach is highly task dependent and calls into question the dominance of multilingual models for cross-lingual classification. |
A Benchmark for Translations Across Styles and Language Variants (2025.findings-emnlp)
Copied to clipboard
| Challenge: | lack of comprehensive evaluation benchmarks has hindered progress in this field . lack of evaluation benchmarking has hinder MT's ability to generate accurate outputs . |
| Approach: | They evaluate translations across semantic preservation, cultural and regional specificity, expression style, and fluency at both the word and sentence levels. |
| Outcome: | The proposed evaluation framework is validated on translations of state-of-the-art large language models . |
Translationese as a Language in “Multilingual” NMT (2020.acl-main)
Copied to clipboard
| Challenge: | Recent work examines the impact of translationese in machine translation evaluation using the WMT evaluation campaign. |
| Approach: | They propose to use a sentence-level classifier to distinguish translationese from original target text to generate a machine translation model that can produce more natural outputs at test time. |
| Outcome: | The proposed model produces more natural outputs at test time, yielding gains in human evaluation scores on accuracy and fluency. |
CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formality (2022.findings-naacl)
Copied to clipboard
| Challenge: | Specific problems arise when translating from English into languages with formality markers, such as “Are you sure?” . Using wrong or inconsistent tone may be perceived as inappropriate or jarring for users of certain cultures and demographics. |
| Approach: | They propose to train formality-controlled models by fine-tuning on labeled contrastive data and a metric to evaluate them. |
| Outcome: | The proposed model achieves high accuracy (82% in-domain and 73% out-of-domain) while maintaining overall quality. |
Machine Translation into Low-resource Language Varieties (2021.acl-short)
Copied to clipboard
| Challenge: | Current machine translation systems generate a "standard" target language, but many languages have multiple varieties that are different from the standard language. |
| Approach: | They propose a framework to rapidly adapt machine translation systems to generate different target varieties . they propose to use no parallel data to generate languages close to, but different from, the standard target language . |
| Outcome: | The proposed model improves on a system that generates Ukrainian and Belarusian in two languages with no parallel data. |
SentSim: Crosslingual Semantic Evaluation of Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | Machine translation (MT) is currently evaluated in one of two ways: monolingually or trained crosslingually by building a supervised model to predict quality scores from human-labeled data. |
| Approach: | They propose an unsupervised model that directly compares the source and machine translated sentence using strong pretrained multilingual word and sentence representations. |
| Outcome: | The proposed model outperforms glass-box approaches to quality estimation that rely on a supervised model. |
Multi-perspective Alignment for Increasing Naturalness in Neural Machine Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Neural machine translation systems amplify lexical biases, rendering outputs artificially impoverished . Attempts to increase naturalness in NMT can fall short in terms of content preservation . |
| Approach: | They propose a method that rewards both naturalness and content preservation . they use multiple perspectives to produce more natural translations . |
| Outcome: | The proposed method produces translations that are lexically richer and exhibit more properties of human-written language without loss in translation accuracy. |
Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models have demonstrated considerable success in various natural language processing tasks, but their performance in NMT tasks is still underexplored. |
| Approach: | They propose to use LLMs as automatic post-editors rather than direct translators to improve BLEU and COMET performance. |
| Outcome: | The proposed approach improves BLEU but COMET performance compared to in-context learning. |
Improving Robustness of Machine Translation with Synthetic Noise (N19-1)
Copied to clipboard
| Challenge: | Recent work on MT robustness has demonstrated the need to build or adapt systems that are resilient to such noise. |
| Approach: | They propose to synthesize natural noise in social media data to enhance robustness of MT systems by leveraging natural noise. |
| Outcome: | The proposed method can make a vanilla MT system more resilient to noise, partially mitigating loss in accuracy resulting therefrom. |
Translating Translationese: A Two-Step Approach to Unsupervised Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Using a dictionary, given a rough, target language natives can uncover the latent, fully-fluent rendering of the translation. |
| Approach: | They propose a method that breaks translation into two steps by generating a dictionary and then ‘translating’ the resulting pseudo-translation into a fully fluent translation. |
| Outcome: | The proposed method 'gets better translation results on high-resource languages than previously published unsupervised MT studies' |