Neural Machine Translation with Heterogeneous Topic Knowledge Embeddings (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing NMT models can handle meaning ambiguities based on local contexts, but it remains a challenge to translate words in implicit collocations. |
| Approach: | They propose heterogeneous ways of embedding topic information into NMT models . they propose to incorporate topic knowledge embeddable into the NMT model . |
| Outcome: | The proposed methods outperform baselines on English -> German and English => French translation tasks. |
Similar Papers
Enhancing Neural Machine Translation Through Target Language Data: A kNN-LM Approach for Domain Adaptation (2025.acl-long)
Copied to clipboard
Abudurexiti Reheman, Hongyu Liu, Junhao Ruan, Abudukeyumu Abudula, Yingfeng Luo, Tong Xiao, JingBo Zhu
| Challenge: | Neural machine translation (NMT) has made significant progress in recent years, yet often suffers from translating in new domains, which is called domain adaptation. |
| Approach: | They propose a method that leverages semantically similar target language sentences in the kNN framework and generates a probability distribution over these sentences during decoding. |
| Outcome: | The proposed method generates a probability distribution over similar target language sentences and then interpolates with the model’s distribution. |
Neural Machine Translation Incorporating Named Entity (C18-1)
Copied to clipboard
| Challenge: | Conventional NMT models have difficulty translating words with multiple meanings because of the high ambiguity. |
| Approach: | They propose a neural machine translation model that incorporates named entity (NE) tags of source-language sentences to reduce the difficulty in translating multiple meanings. |
| Outcome: | The proposed model achieves 3.11 point improvement in bilingual evaluation understudy (BLEU) on English-to-Japanese translation task with the ASPEC, and English- to-Bulgarian and English to-Romanian translation tasks with the Europarl corpus. |
When and Why Are Pre-Trained Word Embeddings Useful for Neural Machine Translation? (N18-2)
Copied to clipboard
| Challenge: | Pre-trained word embeddings have proven to be invaluable for improving performance in natural language analysis tasks where large-scale parallel corpora cannot be obtained. |
| Approach: | They perform five sets of experiments to analyze when pre-trained word embeddings can be useful in NMT tasks. |
| Outcome: | The embeddings provide gains of up to 20 BLEU points in the most favorable setting. |
Learning to Generate Word- and Phrase-Embeddings for Efficient Phrase-Based Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) often fails in one-to-many translation, e.g., in the translation of multi-word expressions, compounds, and collocations. |
| Approach: | They propose a phrase-based NMT model that generates embeddings of words or phrases. |
| Outcome: | The proposed model performs on par with state-of-the-art phrase-based NMT. |
On Search Strategies for Document-Level Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Document-level neural machine translation models produce a more consistent output across a document . however, the exact decoding strategy is often not described and not mentioned at all. |
| Approach: | They propose to use standard automatic metrics and specific linguistic phenomena to compare different decoding schemes. |
| Outcome: | The proposed decoding strategies perform similar to each other on three standard document-level translation benchmarks. |
One Sentence One Model for Neural Machine Translation (L18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a new state of the art that can produce better results than traditional statistical machine translation. |
| Approach: | They propose a dynamic neural network which learns a general network as usual and fine-tunes it for each test sentence. |
| Outcome: | The proposed method improves translation performance when similar sentences are available. |
Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination (D18-1)
Copied to clipboard
| Challenge: | Experimental results on Chinese-English and English-French multi-domain translation tasks demonstrate the effectiveness of the proposed model. |
| Approach: | They propose to use mixed-domain parallel sentences to construct a unified model that allows translation to switch between different domains. |
| Outcome: | The proposed model distinguishes and exploits word-level domain contexts on Chinese-English and English-French translation tasks. |
Exploiting Sentential Context for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to exploit sentential context for machine translation are not well studied. |
| Approach: | They propose a shallow sentential context that exploits top encoder layer, and a deep sentential one that aggregates sentential representations from all internal layers. |
| Outcome: | The proposed model outperforms the strong Transformer model on the English-German and English-French benchmarks. |
Bridging the Gap between Training and Inference for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural Machine Translation generates target words sequentially while at inference it has to generate the entire sequence from scratch. |
| Approach: | They propose to use ground truth and inference to generate target words sequentially while at inference it has to generate the entire sequence from scratch. |
| Outcome: | Experiments on Chinese->English and WMT’14 English->German translation tasks show that the proposed model can achieve significant improvements on multiple datasets. |
Improving Target-side Lexical Transfer in Multilingual Neural Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Multilingual data is more beneficial for NMT models that translate from the LRL to a target language than those that translate into the LLLs. |
| Approach: | They propose a decoder that embeds character n-grams into NMT models that translate from an LRL to a target language. |
| Outcome: | The proposed decoder improves the performance of NMT models that translate from an LRL to a target language. |