Challenge: Neural sequence-to-sequence models are autoregressive, meaning they factor the joint probability of the output sequence into the product of probabilities over the next to-ken.
Approach: They propose a non-autoregressive sequence generation model using latent variables . they use generative flow to model complex distributions using neural networks .
Outcome: The proposed model performs comparable to state-of-the-art models and has constant decoding time w.r.t the sequence length.

Similar Papers

Non-Autoregressive Models for Fast Sequence Generation (2022.emnlp-tutorials)

Copied to clipboard

Challenge: Autoregressive (AR) models can only generate target sequence word-by-word due to the AR mechanism and suffer from slow inference.
Approach: This tutorial provides an introduction to non-autoregressive sequence generation.
Outcome: This tutorial explains how to generate non-autoregressive sequence generation models.
Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement (D18-1)

Copied to clipboard

Challenge: Despite its success, neural autoregressive modeling has its weakness in decoding, i.e., finding the most likely sequence.
Approach: They propose a conditional non-autoregressive neural sequence model based on iterative refinement based upon latent variable models and conditional denoising autoencoders.
Outcome: The proposed model significantly speeds up decoding while maintaining the generation quality comparable to the autoregressive counterpart.
Non-Autoregressive Sequence Generation (2022.acl-tutorials)

Copied to clipboard

Challenge: Non-autoregressive sequence generation (NAR) models generate output sequences in parallel to speed up generation process.
Approach: This tutorial provides a thorough introduction and review of non-autoregressive sequence generation . it aims to generate the entire or partial output sequences in parallel to speed up the generation process .
Outcome: This tutorial provides a thorough introduction and review of non-autoregressive sequence generation . it aims to reduce the performance gap between state-of-the-art models due to lack of modeling power .
JANUS: Joint Autoregressive and Non-autoregressive Training with Auxiliary Loss for Sequence Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to train autoregressive and non-autoregressive models only consider relevance of model parameters, ignoring correlations between the two manners.
Approach: They propose a joint autoregressive and non-autoregressive training method using aUxiliary losS to enhance the model performance in both AR and NAR manners simultaneously.
Outcome: The proposed method improves the model performance in both AR and NAR manners and reduces the inference latency.
A Study of Non-autoregressive Model for Sequence Generation (2020.acl-main)

Copied to clipboard

Challenge: Non-autoregressive (NAR) models generate all tokens in parallel, resulting in faster generation speed compared to autoregressive models.
Approach: They propose to use knowledge distillation and source-target alignment to bridge the gap between NAR and autoregressive models in various tasks.
Outcome: The proposed techniques can speed up NAR models in some tasks but not all . the proposed techniques reduce target token dependency while allowing for faster inference .
Conditional set generation using Seq2seq models (2022.emnlp-main)

Copied to clipboard

Challenge: Several NLP tasks are instances of set generation.
Approach: They propose a model-independent data augmentation approach that enlarges the model with the signals of order-invariance and cardinality.
Outcome: The proposed method improves performance on four benchmark datasets with no additional annotations.
Flow Matching for Conditional Text Generation in a Few Sampling Steps (2024.eacl-short)

Copied to clipboard

Challenge: Current diffusion models face multiple drawbacks including slow sampling, noise schedule sensitivity, and misalignment between training and sampling stages.
Approach: They propose a method which leverages flow matching for conditional text generation.
Outcome: The proposed method can generate text in a few steps by training with a novel anchor loss, alleviating the need for expensive hyperparameter optimization of the noise schedule prevalent in diffusion models.
Non-autoregressive Streaming Transformer for Simultaneous Translation (2023.emnlp-main)

Copied to clipboard

Challenge: Simultaneous machine translation models are trained to strike a balance between latency and translation quality.
Approach: They propose a non-autoregressive streaming Transformer which generates blank tokens and decodes repetitive tokens to adjust its READ/WRITE strategy flexibly.
Outcome: The proposed model outperforms previous strong autoregressive models on various benchmarks on siMT.
Continuous Language Generative Flow (2021.acl-long)

Copied to clipboard

Challenge: Recent years have witnessed various types of generative models for natural language generation (NLG), especially RNNs or transformers.
Approach: They propose a flow-based language generation model that adapts flow-derived generative models to language generation via continuous input embeddings, adapted affine coupling structures, and a novel architecture for autoregressive text generation.
Outcome: The proposed model improves on QG and NMT and improves performance over baselines on SQuAD and TVQA and NML16.
Non-Autoregressive Neural Machine Translation: A Call for Clarity (2022.emnlp-main)

Copied to clipboard

Challenge: Non-autoregressive translation models require a single forward pass to generate the output sequence instead of iteratively producing each predicted token.
Approach: They propose to use a single forward pass to generate the output sequence instead of iteratively producing each predicted token.
Outcome: The proposed models improve translation quality and speed under third-party testing environments.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations