Modeling Coherence for Neural Machine Translation with Dynamic and Topic Caches (C18-1)
Copied to clipboard
| Challenge: | Current neural machine translation systems translate a text sentence-by-sentence, ignoring cross-sentent links and dependencies. |
| Approach: | They propose a cache-based approach to modeling coherence for neural machine translation . they capture contextual information either from recently translated sentences or the entire document . |
| Outcome: | The proposed model improves on state-of-the-art translation models on many languages . it captures contextual information from recently translated sentences or the entire document . |
Similar Papers
A Document-Level Neural Machine Translation Model with Dynamic Caching Guided by Theme-Rheme Information (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies have shown that inter-sentence information is helpful for improving the performance of document-level Neural Machine Translation models, but what information should be regarded as context remains ambiguous. |
| Approach: | They propose a cache-based document-level NMT model which conducts dynamic caching guided by theme-rheme information. |
| Outcome: | The proposed model achieves substantial improvements over the state-of-the-art models on NIST evaluation sets. |
Document Context Neural Machine Translation with Memory Networks (P18-1)
Copied to clipboard
| Challenge: | Experimental results show that our model exploits both source and target document context. |
| Approach: | They propose a document-level neural machine translation model which takes both source and target document context into account using memory networks. |
| Outcome: | The proposed model outperforms previous work in terms of BLEU and METEOR in English translations. |
Neural Machine Translation with Heterogeneous Topic Knowledge Embeddings (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing NMT models can handle meaning ambiguities based on local contexts, but it remains a challenge to translate words in implicit collocations. |
| Approach: | They propose heterogeneous ways of embedding topic information into NMT models . they propose to incorporate topic knowledge embeddable into the NMT model . |
| Outcome: | The proposed methods outperform baselines on English -> German and English => French translation tasks. |
Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training (2021.acl-long)
Copied to clipboard
| Challenge: | Context-aware neural machine translation (NMT) remains challenging due to the lack of large-scale document-level parallel corpora. |
| Approach: | They propose to use large-scale parallel datasets and source-side monolingual documents to improve context-aware neural machine translation. |
| Outcome: | The proposed model can be used to translate both sentences and documents on four translation tasks. |
Towards User-Driven Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | a good translation should implicitly mirror user traits rather than translate the original content semantically. |
| Approach: | They propose a framework that captures user traits from historical inputs . they propose 'user-driven' NMT to model user behavior under a zero-shot learning fashion . |
| Outcome: | The proposed framework can capture user traits from historical inputs under zero-shot learning fashion. |
Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Prior work treats all types of mismatches between source and target as noise . Consequently, it remains unclear how noisy parallel training samples impact NMT training. |
| Approach: | They propose a divergent-aware NMT framework that uses factors to help NMT recover from the degradation caused by naturally occurring divergences. |
| Outcome: | The proposed framework improves translation quality and model calibration on EN-FR tasks. |
Guiding Neural Machine Translation with Retrieved Translation Pieces (N18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has trouble with lowfrequency words or phrases and generalizing across domains. |
| Approach: | They propose a method for recalling low-frequency words and phrases into neural machine translation by retrieving n-grams from a search engine and incorporating them into the decoding process. |
| Outcome: | The proposed method improves translation results up to 6 BLEU points on three narrow domain translation tasks where repetitiveness of the target sentences is particularly salient. |
One Sentence One Model for Neural Machine Translation (L18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a new state of the art that can produce better results than traditional statistical machine translation. |
| Approach: | They propose a dynamic neural network which learns a general network as usual and fine-tunes it for each test sentence. |
| Outcome: | The proposed method improves translation performance when similar sentences are available. |
On Search Strategies for Document-Level Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Document-level neural machine translation models produce a more consistent output across a document . however, the exact decoding strategy is often not described and not mentioned at all. |
| Approach: | They propose to use standard automatic metrics and specific linguistic phenomena to compare different decoding schemes. |
| Outcome: | The proposed decoding strategies perform similar to each other on three standard document-level translation benchmarks. |
Entity-based Neural Local Coherence Modeling (2022.acl-long)
Copied to clipboard
| Challenge: | Recent neural coherence models encode the input document using large-scale pretrained language models. |
| Approach: | They propose an entity-based neural local coherence model which is linguistically more sound than previous models. |
| Outcome: | The proposed model outperforms existing models on three downstream tasks. |