Anticipating Future with Large Language Model for Simultaneous Machine Translation (2025.naacl-long)
Copied to clipboard
Siqi Ouyang, Oleksii Hrinchuk, Zhehuai Chen, Vitaly Lavrukhin, Jagadeesh Balam, Lei Li, Boris Ginsburg
| Challenge: | Existing methods only use the partial utterance that has already arrived at the input and the generated hypothesis. |
| Approach: | They propose to use a large language model to predict future source words and opportunistically translate without introducing too much risk. |
| Outcome: | The proposed method outperforms baselines on four language directions and achieves the best translation quality-latency trade-off by up to 5 BLEU points at the same latency. |
Similar Papers
A Paradigm Shift: The Future of Machine Translation Lies with Large Language Models (2024.lrec-main)
Copied to clipboard
Chenyang Lyu, Zefeng Du, Jitao Xu, Yitao Duan, Minghao Wu, Teresa Lynn, Alham Fikri Aji, Derek F. Wong, Longyue Wang
| Challenge: | Large Language Models (LLMs) are introducing a new phase in machine translation . despite advances in MT, there are still many challenges to overcome . |
| Approach: | They propose to highlight several new directions for MT that are influenced by Large Language Models like GPT-4 and ChatGPT. |
| Outcome: | The proposed models offer vast linguistic understandings and bring innovative methodologies, such as prompt-based techniques, that have the potential to further elevate MT. |
Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing siMT corpora are limited due to high costs and limited annotator capabilities. |
| Approach: | They propose a method to convert ST corpora into interpretation-style corpors by fine-tuning models with Large Language Models. |
| Outcome: | The proposed method reduces latency while achieving better quality compared to other models. |
Prediction Improves Simultaneous Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Current systems for simultaneous machine translation use an AGENT to control an incremental encoder-decoder model. |
| Approach: | They propose a general-purpose prediction action which predicts future words in the input stream. |
| Outcome: | The proposed agent with prediction has better translation quality and less delay compared to an agent-based system without prediction. |
Simul-LLM: A Framework for Exploring High-Quality Simultaneous Translation with Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) contain billions of parameters and can perform a variety of downstream tasks. |
| Approach: | They propose an open-source framework for fine-tuning large language models (LLMs) they address key challenges facing LLMs fine- tuned for simultaneous translation . |
| Outcome: | The proposed framework validates classical SimulMT concepts and practices in the context of LLMs and explores adapting LLM fine-tuned for NMT to the task of Simul-LLM. |
Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategies (2026.findings-acl)
Copied to clipboard
| Challenge: | Simultaneous machine translation requires high-quality translations under strict real-time constraints. |
| Approach: | They extend the action space of simultaneous machine translation with four adaptive actions . they adapt these actions in a large language model framework and construct training references . |
| Outcome: | The proposed framework improves semantic metrics and achieves lower delay compared to reference translations and salami-based baselines. |
Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis (2024.findings-naacl)
Copied to clipboard
Wenhao Zhu, Hongyi Liu, Qingxiu Dong, Jingjing Xu, Shujian Huang, Lingpeng Kong, Jiajun Chen, Lei Li
| Challenge: | Existing studies show that large language models (LLMs) can handle multilingual machine translation (MMT) However, the multilingual translation ability of LLMs remains under-explored. |
| Approach: | They evaluate eight popular LLMs including ChatGPT and GPT-4 to determine their performance in multilingual machine translation. |
| Outcome: | The proposed model can generate moderate translation even on zero-resource languages and cross-lingual exemplars can provide better task guidance for low-resourced translation than exemplar in the same language pairs. |
Combining the Best of Both Worlds: A Method for Hybrid NMT and LLM Translation (2025.findings-acl)
Copied to clipboard
Zhanglin Wu, Daimeng Wei, Xiaoyu Chen, Hengchao Shang, Jiaxin Guo, Zongyao Li, Yuanchang Luo, Jinlong Yang, Zhiqiang Rao, Hao Yang
| Challenge: | Large language models have advantages over neural machine translation systems, but they suffer from high computational costs and significant latency. |
| Approach: | They propose a scheduling policy that optimizes translation result while ensuring fast speed and as little LLM usage as possible. |
| Outcome: | The proposed model achieves optimal translation performance with less LLM usage on multilingual test sets. |
On-the-Fly Fusion of Large Language Models and Machine Translation (2024.findings-naacl)
Copied to clipboard
| Challenge: | a weaker-at-translation LLM can improve translations of a NMT model, compared to a strong dedicated model. |
| Approach: | They propose to ensemble a neural machine translation model with a large language model, prompted on the same task and input. |
| Outcome: | The proposed method can be combined with various techniques from LLM prompting, such as in context learning and translation context. |
Multilingual Simultaneous Neural Machine Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | Simultaneous machine translation (SIMT) involves translating source utterances to the target language in real-time before the speaker utterrance completes. |
| Approach: | They propose a multilingual approach to simultaneous machine translation where a single model simultaneously translates between multiple languages. |
| Outcome: | The proposed multilingual approach improves on two Germanic and three Romance languages and is on-par or better than the universal model trained for all languages. |
Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to simultaneous speech-to-speech translation accumulate more and more latencies in later sentences when the speaker talks faster. |
| Approach: | They propose a method which generates more fluent target speech latency than the baseline . they propose to use self-adaptive translation to adjust the length of translations to accommodate different source speech rates. |
| Outcome: | Xiong et al., 2019) show that the proposed method generates more fluent target speech latency than baseline . authors say it provides more natural communication process than speech-to-text translation . xiong and colleagues say the proposed technique is more efficient than current approaches . |