Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Framework (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for simultaneous machine translation (SiMT) are more challenging since the source sentence is always incomplete during translating. |
| Approach: | They propose a framework to reduce the position bias by bridging the structural gap between SiMT and full-sentence MT. |
| Outcome: | The proposed framework reduces the position bias by bridging the structural gap between SiMT and full-sentence MT. |
Similar Papers
Decoder-only Streaming Transformer for Simultaneous Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for siMT focus on the Encoder-Decoder architecture, but there are limitations in training and inference. |
| Approach: | They propose a model that generates translation while reading source tokens . they propose Streaming Self-Attention mechanism tailored for the Decoder-only architecture . |
| Outcome: | The proposed model achieves state-of-the-art performance on three translation tasks. |
Addressing the Length Bias Challenge in Document-Level Neural Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Document-level neural machine translation (DNMT) models incorporate context information through increased maximum lengths of source and target sentences. |
| Approach: | They propose a sliding decoding strategy that limits the length of target sentences . they propose 'length-normalized attention mechanism' to aid the model in focusing on target information . |
| Outcome: | The proposed method can achieve state-of-the-art results on open datasets. |
Gaussian Multi-head Attention for Simultaneous Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for siMT do not explicitly model the alignment to perform the control. |
| Approach: | They propose to model alignment and translation in a unified manner by Gaussian Multi-head Attention (GMA) they propose to integrate alignment-related priors into the translation model to determine final attention. |
| Outcome: | The proposed method outperforms strong baselines on trade-off between translation and latency. |
Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategies (2026.findings-acl)
Copied to clipboard
| Challenge: | Simultaneous machine translation requires high-quality translations under strict real-time constraints. |
| Approach: | They extend the action space of simultaneous machine translation with four adaptive actions . they adapt these actions in a large language model framework and construct training references . |
| Outcome: | The proposed framework improves semantic metrics and achieves lower delay compared to reference translations and salami-based baselines. |
STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework (P19-1)
Copied to clipboard
Mingbo Ma, Liang Huang, Hao Xiong, Renjie Zheng, Kaibo Liu, Baigong Zheng, Chuanqiang Zhang, Zhongjun He, Hairong Liu, Xing Li, Hua Wu, Haifeng Wang
| Challenge: | Simultaneous translation is notoriously dif- ficult due to word-order differences. |
| Approach: | They propose a prefix-to-prefix framework that implicitly learns to anticipate in a single translation model. |
| Outcome: | The proposed framework achieves low latency and reasonable qual- ity on 4 directions. |
Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to perform adaptive and fixed translations lack evaluation before taking actions. |
| Approach: | They propose a method to perform adaptive translation policy via post-evaluation into fixed policy . their method evaluates rationality of next action by measuring change in source content . |
| Outcome: | The proposed method exceeds strong baselines under all latency. |
Simultaneous Machine Translation with Tailored Reference (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing SiMT models are trained using the same reference disregarding the varying amounts of available source information at different latency. |
| Approach: | They propose a method that provides tailored reference for the SiMT models trained at different latency by rephrasing ground-truth to the tailored reference. |
| Outcome: | The proposed method achieves state-of-the-art translation performance on three translation tasks. |
Simultaneous Machine Translation with Visual Context (2020.emnlp-main)
Copied to clipboard
| Challenge: | Simultaneous machine translation (SiMT) aims to reproduce human interpretation, where an interpreter translates spoken utterances as they are produced. |
| Approach: | They propose to add visual context to siMT to compensate for the missing source context . they show visual-grounded models are much better than commonly used global features . |
| Outcome: | The proposed models reach up to 3 BLEU points improvement under low latency scenarios. |
Self-Modifying State Modeling for Simultaneous Machine Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for simultaneous machine translation fail to optimize the policy . existing methods require building a decision path to learn the policy, but they cannot explore all potential paths . |
| Approach: | They propose a new training paradigm that uses a read/write policy to optimize the policy . existing methods usually require building a decision path to learn a suitable policy a user makes . |
| Outcome: | The proposed model outperforms strong baselines and allows offline models to acquire SiMT ability with fine-tuning. |
Mitigating Tokenization-Induced Distance Distortion in Long-Context Multilingual Machine Translation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing positional encodings rely on fixed token indices and implicitly assume uniform semantic density, which breaks down for long-context inputs. |
| Approach: | They propose a tokenization-aware adaptive positional encoding that conditions relative positional bias on input-level sequence length and fragmentation statistics. |
| Outcome: | The proposed model improves long-context robustness and accuracy over baselines. |