Challenge: Existing methods for siMT focus on the Encoder-Decoder architecture, but there are limitations in training and inference.
Approach: They propose a model that generates translation while reading source tokens . they propose Streaming Self-Attention mechanism tailored for the Decoder-only architecture .
Outcome: The proposed model achieves state-of-the-art performance on three translation tasks.

Similar Papers

Non-autoregressive Streaming Transformer for Simultaneous Translation (2023.emnlp-main)

Copied to clipboard

Challenge: Simultaneous machine translation models are trained to strike a balance between latency and translation quality.
Approach: They propose a non-autoregressive streaming Transformer which generates blank tokens and decodes repetitive tokens to adjust its READ/WRITE strategy flexibly.
Outcome: The proposed model outperforms previous strong autoregressive models on various benchmarks on siMT.
Self-Modifying State Modeling for Simultaneous Machine Translation (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for simultaneous machine translation fail to optimize the policy . existing methods require building a decision path to learn the policy, but they cannot explore all potential paths .
Approach: They propose a new training paradigm that uses a read/write policy to optimize the policy . existing methods usually require building a decision path to learn a suitable policy a user makes .
Outcome: The proposed model outperforms strong baselines and allows offline models to acquire SiMT ability with fine-tuning.
Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Framework (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for simultaneous machine translation (SiMT) are more challenging since the source sentence is always incomplete during translating.
Approach: They propose a framework to reduce the position bias by bridging the structural gap between SiMT and full-sentence MT.
Outcome: The proposed framework reduces the position bias by bridging the structural gap between SiMT and full-sentence MT.
Syntactically Supervised Transformers for Faster Neural Machine Translation (P19-1)

Copied to clipboard

Challenge: Standard decoders for neural machine translation generate a single token per timestep, which slows inference . a series of controlled experiments demonstrates that SynST decodes sentences 5x faster than the baseline autoregressive Transformer.
Approach: They propose a syntactically supervised Transformer that generates all target tokens in one shot . synST is a variant of the Transformer architecture that autoregressively predicts a chunked parse tree .
Outcome: The proposed method decodes sentences 5x faster than the baseline method on En-De and En-Fr datasets while achieving higher BLEU scores.
TransLLaMa: LLM-based Simultaneous Translation System (2024.findings-emnlp)

Copied to clipboard

Challenge: Decoder-only large language models have limited applications in simultaneous machine translation . naively translating each source word immediately results in compromised target quality .
Approach: a study shows that a pre-trained open-source LLM can control input segmentation directly by generating a special "wait" token.
Outcome: a new open-source model can control input segmentation directly by generating a special "wait" token.
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR (2021.findings-acl)

Copied to clipboard

Challenge: Existing approaches to simultaneous speech-to-text translation suffer from error propagation and extra latency.
Approach: They propose a new paradigm for simultaneous speech-to-text translation using two separate decoders . they use multitask learning to jointly learn these two tasks with a shared encoder .
Outcome: The proposed method achieves substantially better translation quality at similar levels of latency.
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation (2020.coling-main)

Copied to clipboard

Challenge: Existing models for automatic speech recognition and multilingual speech translation are on par with cascade counterparts.
Approach: They propose a dual-decoder Transformer architecture that performs automatic speech recognition and multilingual speech translation.
Outcome: The proposed models outperform the previously-reported highest translation performance in multilingual settings and bilingual one-to-one results.
Gaussian Multi-head Attention for Simultaneous Machine Translation (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods for siMT do not explicitly model the alignment to perform the control.
Approach: They propose to model alignment and translation in a unified manner by Gaussian Multi-head Attention (GMA) they propose to integrate alignment-related priors into the translation model to determine final attention.
Outcome: The proposed method outperforms strong baselines on trade-off between translation and latency.
Learning Hard Retrieval Decoder Attention for Transformers (2021.findings-emnlp)

Copied to clipboard

Challenge: In this paper, we show that learning a hard retrieval attention that attends to a single token in a sentence is 1.43 times faster than the standard scaled dot-product attention.
Approach: They propose a method to learn hard retrieval attention where an attention head attends to a single token in a sentence rather than all tokens.
Outcome: The proposed method is 1.43 times faster in decoding while preserving translation quality on a wide range of MT tasks.
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline (2025.findings-acl)

Copied to clipboard

Challenge: Large language models perform well in offline machine translation when the complete source sentence is provided . however, in many real scenarios, the source tokens arrive in a streaming manner and simultaneous machine translation is required .
Approach: They propose a new paradigm that includes constructing supervised fine-tuning data for simultaneous machine translation (SiMT) to achieve SiMT, source and target tokens are rearranged into interleaved sequences, separated by special tokens according to varying latency requirements.
Outcome: The proposed approach achieves state-of-the-art performance across various SiMT benchmarks and evaluation metrics while maintaining efficient auto-regressive decoding.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations