Challenge: et al., 2018: translation errors due to the lack of extra-sentential context are becoming more and more noticeable among otherwise adequate translations.
Approach: They propose a context-aware translation model that uses sentence-level data to identify inconsistencies . standard metrics are not sensitive to improvements in consistency in document-level translations .
Outcome: The proposed model shows major gains over baseline without sacrificing performance . standard metrics are not sensitive to improvements in document-level translations .

Similar Papers

Data augmentation using back-translation for context-aware neural machine translation (D19-65)

Copied to clipboard

Challenge: A single sentence does not always convey information that is enough to translate it into other languages.
Approach: They obtain large-scale pseudo parallel corpora by back-translating monolingual data and examine their impact on translation accuracy.
Outcome: The large-scale pseudo parallel corpora obtained by back-translating monolingual data showed that the model trained with small parallel corporeals and large-sized pseudo parallels improved translation accuracy.
When and Why is Document-level Context Useful in Neural Machine Translation? (D19-65)

Copied to clipboard

Challenge: Recent advances in document-level NMT focus on sophisticated integration of the context, explaining its improvement with only a few selected examples or targeted test sets.
Approach: They extensively quantify the causes of improvements by a document-level model in general test sets, clarifying the limit of the usefulness of document- level context in NMT.
Outcome: The proposed model is not interpretable as utilizing the context, and a long context is not helpful for NMT.
Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training (2021.acl-long)

Copied to clipboard

Challenge: Context-aware neural machine translation (NMT) remains challenging due to the lack of large-scale document-level parallel corpora.
Approach: They propose to use large-scale parallel datasets and source-side monolingual documents to improve context-aware neural machine translation.
Outcome: The proposed model can be used to translate both sentences and documents on four translation tasks.
Encouraging Lexical Translation Consistency for Document-Level Neural Machine Translation (2021.emnlp-main)

Copied to clipboard

Challenge: Experimental results show document-level neural machine translation improves lexical consistency . inconsistent translations tend to confuse readers in some cases .
Approach: They propose to use a word link to obtain a document word link and an auxiliary loss function to constrain that their translation should be consistent.
Outcome: The proposed approach improves translation consistency on ChineseEnglish and EnglishFrench translation tasks.
Challenges in Context-Aware Neural Machine Translation (2023.emnlp-main)

Copied to clipboard

Challenge: despite well-reasoned intuitions, most context-aware neural machine translation models show only modest improvements over sentence-level systems.
Approach: They propose a more realistic setting for document-level translation called paragraph-to-paragraph (PARA2PARA) they collect a dataset of Chinese-English novels to promote future research .
Outcome: The proposed model improves translation quality across document-level metrics and discourse phenomena.
Do Context-Aware Translation Models Pay the Right Attention? (2021.acl-long)

Copied to clipboard

Challenge: Context-aware machine translation models fail to leverage contextual information to resolve ambiguous words and pronouns.
Approach: They propose a new dataset that includes supporting context words for 14K translations that professional translators found useful for pronoun disambiguation.
Outcome: The proposed model can automatically disambiguate pronouns and polysemous words when they are not in the same context.
On Search Strategies for Document-Level Neural Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Document-level neural machine translation models produce a more consistent output across a document . however, the exact decoding strategy is often not described and not mentioned at all.
Approach: They propose to use standard automatic metrics and specific linguistic phenomena to compare different decoding schemes.
Outcome: The proposed decoding strategies perform similar to each other on three standard document-level translation benchmarks.
Revisiting Context Choices for Context-aware Machine Translation (2024.lrec-main)

Copied to clipboard

Challenge: Recent work has cast doubt on whether context-aware machine translation models learn useful signals from context or are improvements in automatic evaluation metrics just a side-effect.
Approach: They propose to use separate encoders for source sentence and context as multiple sources for one target sentence to train context-aware machine translation models.
Outcome: The proposed model improves translation quality even with empty lines as context, but the correct context improves it and random out-of-domain context degrades it.
Investigating Failures of Automatic Translation in the Case of Unambiguous Gender (2022.acl-long)

Copied to clipboard

Challenge: Existing models are unable to make basic deductions regarding how to correctly inflect nouns with grammatical gender.
Approach: They propose to evaluate NMT models' ability to translate gender morphology correctly in unambiguous contexts across syntactically diverse sentences.
Outcome: The proposed model was unable to translate gender morphology correctly in unambiguous contexts across syntactically diverse sentences.
Corpora for Document-Level Neural Machine Translation (2020.lrec-1)

Copied to clipboard

Challenge: Document-level machine translation models translate sentences in isolation, but there are three main problems for document-level models.
Approach: They propose to use document-level machine translation to capture discourse dependencies across sentences by considering a document as a whole.
Outcome: The proposed method captures discourse dependencies across sentences by considering a document as a whole.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations