Corpora for Document-Level Neural Machine Translation (2020.lrec-1)

Copied to clipboard

Challenge: Document-level machine translation models translate sentences in isolation, but there are three main problems for document-level models.
Approach: They propose to use document-level machine translation to capture discourse dependencies across sentences by considering a document as a whole.
Outcome: The proposed method captures discourse dependencies across sentences by considering a document as a whole.

Similar Papers

Hierarchical Modeling of Global Context for Document-Level Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Document-level machine translation (MT) remains challenging due to the difficulty in efficiently using document context.
Approach: They propose a hierarchical model to learn document context for document-level neural machine translation . they use a sentence encoder to capture intra-sentence dependencies and a document encoder .
Outcome: The proposed model significantly improves document-level translation performance over strong baselines.
On Search Strategies for Document-Level Neural Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Document-level neural machine translation models produce a more consistent output across a document . however, the exact decoding strategy is often not described and not mentioned at all.
Approach: They propose to use standard automatic metrics and specific linguistic phenomena to compare different decoding schemes.
Outcome: The proposed decoding strategies perform similar to each other on three standard document-level translation benchmarks.
When and Why is Document-level Context Useful in Neural Machine Translation? (D19-65)

Copied to clipboard

Challenge: Recent advances in document-level NMT focus on sophisticated integration of the context, explaining its improvement with only a few selected examples or targeted test sets.
Approach: They extensively quantify the causes of improvements by a document-level model in general test sets, clarifying the limit of the usefulness of document- level context in NMT.
Outcome: The proposed model is not interpretable as utilizing the context, and a long context is not helpful for NMT.
Document Graph for Neural Machine Translation (2021.emnlp-main)

Copied to clipboard

Challenge: Existing document-level NMT methods fail to leverage contexts beyond a few set of previous sentences.
Approach: They propose to represent a document as a graph that connects relevant contexts regardless of distances.
Outcome: Experiments on IWSLT English–French, Chinese-English, WMT English–German and Opensubtitle English–Russian show that using document graphs can significantly improve translation quality.
Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training (2021.acl-long)

Copied to clipboard

Challenge: Context-aware neural machine translation (NMT) remains challenging due to the lack of large-scale document-level parallel corpora.
Approach: They propose to use large-scale parallel datasets and source-side monolingual documents to improve context-aware neural machine translation.
Outcome: The proposed model can be used to translate both sentences and documents on four translation tasks.
Encouraging Lexical Translation Consistency for Document-Level Neural Machine Translation (2021.emnlp-main)

Copied to clipboard

Challenge: Experimental results show document-level neural machine translation improves lexical consistency . inconsistent translations tend to confuse readers in some cases .
Approach: They propose to use a word link to obtain a document word link and an auxiliary loss function to constrain that their translation should be consistent.
Outcome: The proposed approach improves translation consistency on ChineseEnglish and EnglishFrench translation tasks.
Rethinking Document-level Neural Machine Translation (2022.findings-acl)

Copied to clipboard

Challenge: Neural machine translation models are weak enough for document-level translation . current models only translate sentences individually, resulting in poor document coherence .
Approach: They propose to use the original Transformer model to test document-level neural machine translation . they find that the original transformer models can achieve strong results for document translation if trained properly .
Outcome: The proposed model outperforms sentence-level models on nine datasets and two sentence- level datasets across six languages.
TANDO: A Corpus for Document-level Machine Translation (2022.lrec-1)

Copied to clipboard

Challenge: Document-level Neural Machine Translation aims to increase the quality of neural translation models by taking into account contextual information.
Approach: They propose to use document-level corpus for Basque-Spanish language pairs to take into account contextual information and perform fine-grained evaluations of gender and gender.
Outcome: The proposed corpus is suitable for fine-grained evaluation of document-level machine translation systems.
Improving the Transformer Translation Model with Document-Level Context (D18-1)

Copied to clipboard

Challenge: Existing models for document-level context translation ignore documentlevel context.
Approach: They propose a document-level context encoder to represent document- level context and integrate it into the Transformer model.
Outcome: Experiments on NIST Chinese-English and IWSLT French-English datasets show that the proposed translation model outperforms the Transformer model significantly.
A Survey of Domain Adaptation for Neural Machine Translation (C18-1)

Copied to clipboard

Challenge: Neural machine translation (NMT) is a deep learning based approach for machine translation.
Approach: They propose to use a deep learning approach to train machine translation in scenarios where large-scale parallel corpora are available.
Outcome: The proposed approach yields the state-of-the-art translation performance in resource rich scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations