Challenge: Experimental results show that the Reinforce-NAT system surpasses the baseline NAT system by a significant margin on BLEU without decelerating the decoding speed.
Approach: They propose a sequence-level training method and a Transformer decoder to fuse the target sequential information into the top layer of the decoded Transformer.
Outcome: The proposed model surpasses the baseline NAT system on BLEU without decelerating the decoding speed and achieves comparable translation performance to the autoregressive Transformer model with considerable speedup.

Similar Papers

Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade (2021.findings-acl)

Copied to clipboard

Challenge: Existing non-autoregressive neural machine translation models are slow to learn the dependency between output tokens.
Approach: They propose to use fully non-autoregressive neural machine translation (NAT) to predict tokens with single forward of neural networks.
Outcome: The proposed model achieves state-of-the-art results on three translation benchmarks with comparable performance to autoregressive and iterative NAT systems.
Improving Non-Autoregressive Neural Machine Translation via Modeling Localness (2022.coling-1)

Copied to clipboard

Challenge: Existing non-autoregressive neural machine translation models suffer from poor localization quality due to sequential dependencies within the target sentence.
Approach: They propose to introduce local information into NAT models by explicitly introducing local information about surrounding words into the encoder and decoder sides to achieve localness-aware representations.
Outcome: The proposed method can achieve significant improvements over strong NAT baselines.
Integrating Translation Memories into Non-Autoregressive Machine Translation (2023.eacl-main)

Copied to clipboard

Challenge: Non-autoregressive machine translation (NAT) has made great progress, but most studies focus on standard translation tasks.
Approach: They propose to train an edit-based NAT model with a Translation Memory (TM) they propose to modify the data presentation and introduce an extra deletion operation to reduce decoding load.
Outcome: The proposed model performs on par with an autoregressive approach while reducing the decoding load.
Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing non-autoregressive neural machine translation models suffer from multi-modality problem . despite their autoregressivity, most NMT models suffer with slow decoding speed .
Approach: They propose a semi-autoregressive model which generates a translation as a sequence of segments while each segment is predicted token-by-token.
Outcome: The proposed model can achieve 4 times speedup while maintaining comparable performance.
Enriching Non-Autoregressive Transformer with Syntactic and Semantic Structures for Neural Machine Translation (2021.eacl-main)

Copied to clipboard

Challenge: Existing non-autoregressive models have boosted the efficiency of neural machine translation, but their performance is significantly worse than that of autoregressive counterparts.
Approach: They propose to incorporate syntactic and semantic structures among natural languages into a non-autoregressive Transformer for the task of neural machine translation.
Outcome: The proposed model achieves faster speed and keeps translation quality compared with other models.
Viterbi Decoding of Directed Acyclic Transformer for Non-Autoregressive Machine Translation (2022.findings-emnlp)

Copied to clipboard

Challenge: Non-autoregressive models lack the ability to capture sequential dependency . Existing approaches to model sequential dependency have to apply a sequential decision process at inference time .
Approach: They propose a Viterbi decoding framework to capture sequential dependency . they propose to find the optimal translation path under any length constraint .
Outcome: The proposed framework improves the performance of DA-Transformer while maintaining similar speedup.
Syntactically Supervised Transformers for Faster Neural Machine Translation (P19-1)

Copied to clipboard

Challenge: Standard decoders for neural machine translation generate a single token per timestep, which slows inference . a series of controlled experiments demonstrates that SynST decodes sentences 5x faster than the baseline autoregressive Transformer.
Approach: They propose a syntactically supervised Transformer that generates all target tokens in one shot . synST is a variant of the Transformer architecture that autoregressively predicts a chunked parse tree .
Outcome: The proposed method decodes sentences 5x faster than the baseline method on En-De and En-Fr datasets while achieving higher BLEU scores.
Hybrid-Regressive Paradigm for Accurate and Speed-Robust Neural Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Autoregressive translation (NAT) is less robust in decoding batch size and hardware settings than NAT.
Approach: They propose a two-stage translation prototype that prompts a small number of AT predictions and fills in previously skipped tokens at once.
Outcome: The proposed translation prototype achieves comparable translation quality with AT while having 1.5x faster inference speed regardless of batch size and device.
Tree-Structured Non-Autoregressive Decoding for Sequence-to-Sequence Text Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Autoregressive Transformers suffer from high inference latency due to sequential token generation.
Approach: They propose a tree-structured non-autoregressive decoding paradigm that bridges autoregressive and non-automatic decoding.
Outcome: The proposed paradigm outperforms autoregressive and non-autoregressive decoding in machine translation and paraphrase generation.
Non-Autoregressive Neural Machine Translation: A Call for Clarity (2022.emnlp-main)

Copied to clipboard

Challenge: Non-autoregressive translation models require a single forward pass to generate the output sequence instead of iteratively producing each predicted token.
Approach: They propose to use a single forward pass to generate the output sequence instead of iteratively producing each predicted token.
Outcome: The proposed models improve translation quality and speed under third-party testing environments.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations