| Challenge: | Standard machine translation systems process sentences in isolation and ignore extra-sentential information. |
| Approach: | They propose a context-aware neural machine translation model that controls flow of information from extended context to the translation model. |
| Outcome: | The proposed model improves on an English-Russian subtitles dataset over its context-agnostic version (+0.7) and over simple concatenation of context and source sentences (+0.6). |
Similar Papers
Context-aware Decoder for Neural Machine Translation using a Target-side Document-Level Language Model (2021.naacl-main)
Copied to clipboard
| Challenge: | Neural machine translation models that incorporate inter-sentential contexts can be trained only in document-level parallel data with sentential alignments. |
| Approach: | They propose a method to perform context-aware decoding with any pre-trained translation model . their method uses sentence-level parallel data and target-side document-level monolingual data . |
| Outcome: | The proposed method performs context-aware decoding on English to Russian translation using BLEU and contrastive tests. |
Does Context Help Mitigate Gender Bias in Neural Machine Translation? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Neural machine translation models perpetuate gender bias in their training data distribution. |
| Approach: | They examine the gender bias in Neural Machine Translation by using context-aware models to enhance translation accuracy for feminine terms and translation with non-informative context in Basque to Spanish. |
| Outcome: | The proposed models can maintain or even amplify gender bias in translations of stereotypical professions in English and with non-informative context in Basque to Spanish. |
Contextual Neural Machine Translation Improves Translation of Cataphoric Pronouns (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have focused on past sentences as context with a focus on anaphora translation. |
| Approach: | They propose to use future context to improve NMT performance by comparing a contextual NMT model trained with past context to a context-agnostic model. |
| Outcome: | The proposed model outperforms the context-agnostic Transformer and shows comparable and in some cases improved performance. |
Challenges in Context-Aware Neural Machine Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | despite well-reasoned intuitions, most context-aware neural machine translation models show only modest improvements over sentence-level systems. |
| Approach: | They propose a more realistic setting for document-level translation called paragraph-to-paragraph (PARA2PARA) they collect a dataset of Chinese-English novels to promote future research . |
| Outcome: | The proposed model improves translation quality across document-level metrics and discourse phenomena. |
Context-aware Neural Machine Translation with Coreference Information (D19-65)
Copied to clipboard
| Challenge: | Existing models for translating a sentence in a text do not consider coreference relations provided within the text. |
| Approach: | They propose a graph-based encoder which can consider coreference relations provided within the text explicitly. |
| Outcome: | The proposed model improves on the previous approach by 0.9 points on the BLEU score . the graph-based encoder can handle a longer text well, compared with the previous model . |
Data augmentation using back-translation for context-aware neural machine translation (D19-65)
Copied to clipboard
| Challenge: | A single sentence does not always convey information that is enough to translate it into other languages. |
| Approach: | They obtain large-scale pseudo parallel corpora by back-translating monolingual data and examine their impact on translation accuracy. |
| Outcome: | The large-scale pseudo parallel corpora obtained by back-translating monolingual data showed that the model trained with small parallel corporeals and large-sized pseudo parallels improved translation accuracy. |
How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts. (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Neural Machine Translation systems are prone to gender biases in their learned representations. |
| Approach: | They propose to use contextual sentences to correct gender bias in Neural Machine Translation models. |
| Outcome: | The proposed method can be used to build better, bias-free translation systems. |
Measuring and Increasing Context Usage in Context-Aware Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Recent work in neural machine translation has demonstrated the necessity and feasibility of using inter-sentential context, but it is often not clear how much they actually utilize it at translation time. |
| Approach: | They propose a conditional cross-mutual information metric to quantify usage of context by model architectures that can use it at translation time. |
| Outcome: | The proposed method increases context usage and improves translation quality according to BLEU and COMET metrics. |
Evaluating Pronominal Anaphora in Machine Translation: An Evaluation Measure and a Test Suite (D19-1)
Copied to clipboard
| Challenge: | Currently, machine translation is performed at the level of individual sentences, in isolation from the rest of the document. |
| Approach: | They propose a dataset that can be used as a test suite for pronoun translation . they propose an evaluation measure to differentiate good and bad pronounce translations . |
| Outcome: | The proposed dataset can be used as a test suite for pronoun translation in English . it covers multiple source languages and different pronouner errors drawn from real system translations . |
Context-Aware Neural Machine Translation Decoding (D19-65)
Copied to clipboard
| Challenge: | Existing approaches to enhance neural machine translation systems to take into account document-level information make the training process slower or require document- level annotated data. |
| Approach: | They propose a decoding architecture that fuses the semantic space language model and a neural translation model. |
| Outcome: | The proposed approach improves translation quality for English–Spanish using BLEU and METEOR. |