Retrieving Examples from Memory for Retrieval Augmented Neural Machine Translation: A Systematic Comparison (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to extract examples from memory are limited, but the upstream retrieval step is still unexplored. |
| Approach: | They propose to use a standard autoregressive model, edit-based model and a large language model with in-context learning to investigate the effect of retrieval methods on translation scores. |
| Outcome: | The proposed architectures improve translation scores and increase diversity of examples. |
Similar Papers
Rethinking Translation Memory Augmented Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to enhance neural machine translation (NMT) by using a TM have been reported to be effective. |
| Approach: | They propose a translation memory augmented neural machine translation model that is good at fitting data but more sensitive to fluctuations in training data. |
| Outcome: | The proposed model achieves consistent gains over conventional and existing models under two variance-preferable scenarios as well as the high resource scenario. |
Neural Machine Translation with Contrastive Translation Memories (2022.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that retrieval-augmented NMT model obtains substantial improvements over strong baselines in the benchmark dataset. |
| Approach: | They propose a retrieval-augmented NMT model that is holistically similar to the source sentence while individually contrastive to each other. |
| Outcome: | The proposed model improves on baselines in the translation task. |
Towards Example-Based NMT with Multi-Levenshtein Transformers (2023.emnlp-main)
Copied to clipboard
| Challenge: | Retrieval-augmented machine translation (RAMT) is attracting growing attention . it is assumed to implement some form of domain adaptation . |
| Approach: | They propose a retrieval-augmented version of the Levenshtein Transformer to make it more transparent . they propose to perform training and inference in this model, based on multi-way alignment algorithms and imitation learning. |
| Outcome: | The proposed architecture improves translation performance and improves consistency of translations compared to previous models. |
More room for language: Investigating the effect of retrieval on language models (2024.naacl-short)
Copied to clipboard
| Challenge: | Retrieval-augmented language models are a promising alternative to standard pretraining, but little attention has been put into understanding what this type of training scheme does to the underlying language model when analyzed as a standalone -separated from the overall retrieval pipeline. |
| Approach: | They propose an ‘ideal retrieval’ methodology to study these models in a fully controllable setting and propose a retrieval augmentation methodology to examine their effects. |
| Outcome: | The proposed model saves substantially less world knowledge in their weights, but is worse at comprehending global context. |
In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have shown that in-context examples for machine translation are beneficial for high-resource languages. |
| Approach: | They propose to use in-context examples for machine translation (MT) they argue that similarity-based selection can improve MT . |
| Outcome: | The proposed approach improves machine translation (MT) and low-resource languages. |
Learning Kernel-Smoothed Machine Translation with Retrieved Examples (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to update deployed models are prone to overfit . however, non-parametric methods are liable to over-fit the retrieved examples . |
| Approach: | They propose to learn Kernel-Smoothed Translation with Example Retrieval (KSTER) this approach allows users to adapt models to emerging cases without retraining . |
| Outcome: | The proposed approach achieves 1.1 to 1.5 BLEU scores over existing methods without retraining . the proposed model is released on https://github.com/jiangqn/KSTER. |
Improving Retrieval Augmented Neural Machine Translation by Controlling Source and Fuzzy-Match Interactions (2023.findings-eacl)
Copied to clipboard
| Challenge: | a general-domain model has access to customer or domain specific parallel data at inference time, but not during training. |
| Approach: | They propose a zero-shot adaptation approach where a general-domain model has access to customer or domain specific parallel data at inference time, but not during training. |
| Outcome: | The proposed architecture outperforms existing architectures in two language pairs . it consistently improves BLEU across language pair, domain, and number k of fuzzy matches . |
Pluggable Neural Machine Translation Models via Memory-augmented Adapters (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent years, neural machine translation systems are often developed with large-scale parallel data extracted from the Web. |
| Approach: | They propose a memory-augmented adapter to steer pretrained neural machine translation models in a pluggable manner by combining model representations and retrieved results. |
| Outcome: | The proposed method outperforms several representative pluggable baselines on style- and domain-specific experiments. |
Towards Modeling the Style of Translators in Neural Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | a key ingredient of neural machine translation is the use of large datasets with different but consistent translation styles . however, the models do not capture the variety of translators' styles from the data . a recent study shows that style-augmented models can capture the style variations of translator . |
| Approach: | They propose to augment a neural machine translation model with translator information . they use TED talk datasets to model and control translator-related stylistic variations . |
| Outcome: | The proposed models capture the style variations of translators and generate translations with different styles on new data. |
Retrieval-Augmented Machine Translation with Unstructured Knowledge (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a new approach to enhance large language models (LLMs). |
| Approach: | They propose a multi-task training method to teach LLMs how to use information from multilingual documents during their translation. |
| Outcome: | The proposed method improves LLMs by 1.6-3.1 BLEU and 1.0-2.0 COMET scores in En-Zh, and 1.7-2.9 BLUE and 2.1-2.7 COMET score in En de. |