Papers with GANs
Deep Adversarial Learning for NLP (N19-5)
Copied to clipboard
| Challenge: | Adversarial learning is a game-theoretic learning paradigm that has achieved huge successes in the field of Computer Vision recently. |
| Approach: | This tutorial introduces the foundations of deep adversarial learning and some practical problems and solutions in NLP. |
| Outcome: | This tutorial introduces the foundations of deep adversarial learning and some practical problems and solutions in NLP. |
Unsupervised Neural Machine Translation with Weight Sharing (P18-1)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (NMT) is a new approach for machine translation . the model uses only one shared encoder to map pairs of sentences from different languages to a shared-latent space . |
| Approach: | They propose an unsupervised approach which trains the model without labeling data . they propose two independent encoders but share some partial weights to extract high-level representations of input sentences. |
| Outcome: | The proposed approach achieves significant improvements on English-German, English-French and Chinese-to-English translation tasks. |
Generating Text through Adversarial Training Using Skip-Thought Vectors (N19-3)
Copied to clipboard
| Challenge: | Existing approaches to use word embeddings for text generation have been limited. |
| Approach: | They propose to use GANs with word embeddings to reproduce writing style in text . they use a sentence embeddable vector to model people's way of expression . |
| Outcome: | The proposed model outperforms baseline text generation networks across several metrics including BLEU-n, METEOR and ROUGE. |
P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Contemporary approaches to generate tabular data are limited due to the lack of external knowledge. |
| Approach: | They propose to use proximal policy optimization to apply GANs and fine-tune Large Language Models to enhance the probability distribution of tabular features. |
| Outcome: | The proposed method improves accuracy of GANs and LLMs over state-of-the-art over three real-world datasets. |
Making Use of Latent Space in Language GANs for Generating Diverse Text without Pre-training (2021.eacl-srw)
Copied to clipboard
| Challenge: | Existing models for generating diverse texts are not pre-trained . generative adversarial networks suffer from mode-collapsing if they are not trained . |
| Approach: | They propose a GAN model that produces diverse texts conditioned by latent code . they propose to use Gumbel-Softmax distribution for word sampling . |
| Outcome: | The proposed model is competitive with existing models, which requires pre-training. |
So Different Yet So Alike! Constrained Unsupervised Text Style Transfer (2022.acl-long)
Copied to clipboard
| Challenge: | Automated transfer of text between domains does not maintain other attributes between the source and translated text. |
| Approach: | They propose a method for automatic transfer of text between domains that preserves semantic content but changes other attributes. |
| Outcome: | The proposed method retains lexical, syntactic and domain-specific constraints between domains for multiple benchmark datasets, including ones where more than one attribute change. |
Multi-Adversarial Learning for Cross-Lingual Word Embeddings (2021.naacl-main)
Copied to clipboard
| Challenge: | Generative adversarial networks (GANs) have succeeded in inducing cross-lingual word embeddings without supervision, but their performance for distant languages is still not satisfactory. |
| Approach: | They propose a multi-adversarial method that induces the seed cross-lingual dictionary through multiple mappings, each induced to fit the mapping for one subspace. |
| Outcome: | The proposed method improves performance on bilingual lexicon induction and cross-lingual document classification on unsupervised bilingual linguistic induction. |
Why is unsupervised alignment of English embeddings from different algorithms so hard? (D18-1)
Copied to clipboard
| Challenge: | a new paper challenges word embedding algorithms to align independent English word embeds with 100% precision . authors show that when two different embeddables are used, they fail to do so . |
| Approach: | They propose to use unsupervised bilingual dictionary induction to study English-English alignments. |
| Outcome: | The proposed approach is more of a challenge than a technical contribution . it shows that the results challenge unsupervised bilingual dictionary induction algorithms . |
Learning from Few Samples: A Novel Approach for High-Quality Malcode Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Intrusion detection systems (IDS) are limited in labeled samples due to scarcity and lack of diversity in malicious samples. |
| Approach: | They propose a semi-supervised framework that integrates Generative Adversarial Networks with Large Language Models to enhance malicious code generation and SQL Injection detection capabilities. |
| Outcome: | The proposed framework enhances malicious code generation and detection capabilities in few-sample learning scenarios. |
Out-of-domain Detection based on Generative Adversarial Network (D18-1)
Copied to clipboard
| Challenge: | Existing methods for out-of-domain (OOD) detection require huge effort to collect OOD sentences. |
| Approach: | They propose to use only in-domain (IND) sentences to build a generative adversarial network (GAN) of which the discriminator generates low scores for OOD sentences. |
| Outcome: | The proposed method is most accurate compared to existing methods on multi-domain dialog systems. |
Data Augmentation for Hypernymy Detection (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for supervised inference have limited quality training data. |
| Approach: | They propose two techniques which generate new training examples from existing ones . they combine linguistic principles of hypernym transitivity and intersective modifier-noun composition . |
| Outcome: | The proposed techniques generate new training examples from existing datasets. |
Improving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets (N18-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed model consistently outperforms the traditional RNNSearch and the newly emerged state-of-the-art Transformer on English-German and Chinese-English translation tasks. |
| Approach: | They propose an approach for applying GANs to NMT by building a conditional sequence generative adversarial net with two adversarials. |
| Outcome: | The proposed model outperforms the existing RNNSearch and Transformer on English-German and Chinese-English translation tasks. |
KBGAN: Adversarial Learning for Knowledge Graph Embeddings (N18-1)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding techniques lack the capability to access similarities between entities and relations. |
| Approach: | They propose an adversarial learning framework to improve knowledge graph embedding models . they use one knowledge graph embedded model as a negative sample generator . |
| Outcome: | The proposed framework improves the performance of knowledge graph embedding models on a link prediction task. |
Exploring How Generative Adversarial Networks Learn Phonological Representations (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies in natural language processing (NLP) have demonstrated two generic trends: neural networks dominate language-specific machine learning models; the interpretability of these models is limited that the language representation they learned might not align to human language. |
| Approach: | They propose to use a phonological feature-learning architecture to encode contrastive and non-contrastive nasality in French and English vowels. |
| Outcome: | The proposed architecture encodes contrastive and non-contrastive nasality in French and English vowels. |
RetroGAN: A Cyclic Post-Specialization System for Improving Out-of-Knowledge and Rare Word Representations (2021.findings-acl)
Copied to clipboard
| Challenge: | Retrofitting is a technique used to move word vectors closer together or further apart in their space to reflect their relationships in a Knowledge Base (KB). |
| Approach: | They propose a system that uses two GANs to learn a one-to-one mapping between concepts and retrofitted counterparts. |
| Outcome: | The proposed system performs well on word-similarity benchmarks and a sentence simplification task. |
Evaluating Text GANs as Language Models (N19-1)
Copied to clipboard
| Challenge: | Generative Adversarial Networks (GANs) do not suffer from the problem of exposure bias. |
| Approach: | They propose to approximate the distribution of text generated by a GAN and compare it to traditional probability-based LM metrics. |
| Outcome: | The proposed method performs significantly worse than state-of-the-art LMs on several GAN-based models and can accelerate progress in GAN text generation. |
Latent Code and Text-based Generative Adversarial Networks for Soft-text Generation (N19-1)
Copied to clipboard
| Challenge: | Text generation with generative adversarial networks (GANs) can be divided into text-based and code-based categories depending on the type of signals used for discrimination. |
| Approach: | They propose a text-based approach to exploit generative adversarial networks (GANs) by using autoencoders to provide a continuous representation of sentences, which they will refer to as soft-text, and hybrid latent code and text-oriented approaches with one or more discriminators. |
| Outcome: | The proposed approach outperforms the traditional GAN-based methods on two well-known datasets. |
CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Neural Text-to-Speech systems are a promising approach for high-fidelity speech synthesis . but the efficiency of multi-step sampling in Diffusion Models presents challenges . |
| Approach: | They propose a novel architecture grounded in consistency models to improve model convergence. |
| Outcome: | The proposed architecture achieves top-quality speech synthesis in fewer steps without adversarial training or pre-trained model dependencies. |
Adversarial Grammatical Error Correction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that adversarial-GEC can achieve competitive GEC quality compared to NMT-based baselines. |
| Approach: | They propose an adversarial approach to Grammatical Error Correction using a transformer-based model and a sentence-pair classification model. |
| Outcome: | The proposed approach achieves competitive GEC quality compared to baselines. |
Counter-Contrastive Learning for Language GANs (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Generative Adversarial Networks (GANs) have proven to be difficult to generate natural language due to the uninformative learning signals passed from the discriminator. |
| Approach: | They propose to adopt the counter-contrastive learning method to support the generator’s training in language GANs by pulling the language representations of generated and real samples together and pushing apart representations. |
| Outcome: | The proposed method outperforms existing GANs on synthetic and real benchmarks and yields competitive performance compared to previous methods. |
TILGAN: Transformer-based Implicit Latent GAN for Diverse and Coherent Text Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing autoregressive models suffer from the exposure bias problem due to mismatches between training and generation stages. |
| Approach: | They propose a Transformerbased Implicit Latent GAN which combines a transformer autoencoder and GAN in the latent space with a novel design and distribution matching based on the Kullback-Leibler divergence. |
| Outcome: | The proposed model improves local and global coherence and quality-diversity trade-off on three benchmark datasets. |
FastDiff 2: Revisiting and Incorporating GANs and Diffusion Models in High-Fidelity Speech Synthesis (2023.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show that Generative adversarial networks sacrifice sample diversity for quality and speed, while diffusion models exhibit outperformed sample quality and diversity at a high computational cost. |
| Approach: | They propose to combine GANs and diffusion probabilistic models to achieve better sample quality and diversity. |
| Outcome: | The proposed models outperform GANs and diffusion models in speech synthesis . the proposed models enjoy an efficient 4-step sampling process and exhibit better sample diversity . |
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator (2023.acl-long)
Copied to clipboard
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li
| Challenge: | Existing pre-training methods underutilize the benefits of language understanding for generation. |
| Approach: | They propose a GAN-style model for encoder-decoder pre-training with an auxiliary discriminator. |
| Outcome: | The proposed model outperforms existing pre-trained models and achieves state-of-the-art performance. |
Best Student Forcing: A Simple Training Mechanism in Adversarial Language Generation (2020.lrec-1)
Copied to clipboard
| Challenge: | Language models trained with Maximum Likelihood Estimation (MLE) have been considered as a mainstream solution in Natural Language Generation (NLG) however, they are reportedly suffering from training instability and mode collapse, and therefore outperform conventional MLE models. |
| Approach: | They propose a method to improve Generative Adversarial Nets (GANs) using best student forcing and discriminators to increase training stability and sample diversity. |
| Outcome: | The proposed techniques outperform MLE models and outperformed existing approaches in terms of sample diversity and training stability. |
A Universal Discriminator for Zero-Shot Generalization (2023.acl-long)
Copied to clipboard
| Challenge: | Generative modeling has been the dominant approach for large-scale pretraining and zeroshot generalization. |
| Approach: | They propose a discriminator that predicts whether a text sample comes from the true data distribution and which option has the highest probability of coming from the real data distribution. |
| Outcome: | The proposed discriminative approach outperforms GANs on a number of NLP tasks by 16.0%, 7.8%, and 11.5% respectively. |
When Generative Adversarial Networks Meet Sequence Labeling Challenges (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for sequence labeling use a feature extractor and sequence tagger . a recent study shows that SLGAN is versatile and highly effective . |
| Approach: | They propose a framework that harnesses the capabilities of Generative Adversarial Networks to address sequence labeling challenges. |
| Outcome: | The proposed framework exhibits strong adaptability to various sequence labeling tasks. |
A Preliminary Exploration of GANs for Keyphrase Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on extractive keyphrases have shown promising results, but the results suggest that there is room for improvement. |
| Approach: | They propose a new keyphrase generation approach using Generative Adversarial Networks (GANs) their model produces a sequence of keyphrases and a discriminator distinguishes between human-curated and machine-generated keyphrase. |
| Outcome: | The proposed model outperforms the state-of-the-art generative models on benchmark datasets and is comparable to the best performing extractive models. |
InfAL: Inference Time Adversarial Learning for Improving Research Ideation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Advancements in Large Language Models (LLMs) have opened new opportunities for scientific discovery by assisting researchers in generating novel hypotheses and ideas. |
| Approach: | They propose an inference time adversarial learning approach that optimizes the utilization of LLMs’ parametric knowledge without additional model training. |
| Outcome: | The proposed approach optimizes the utilization of LLMs’ parametric knowledge without requiring additional model training, making adversarial learning efficient and context-driven. |
Releasing the Capacity of GANs in Non-Autoregressive Image Captioning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive (NAR) models suffer from their inherent multi-modality problem. |
| Approach: | They propose an Adversarial Non-autoregressive Transformer for Image Captioning that improves model performance by modifying model structure to be compatible with contrastive learning. |
| Outcome: | The proposed model achieves 26.72 times faster than the autoregressive model on the MSCOCO dataset. |
Hierarchical Representation Alignment Learning of Diffusion Transformers for Neural Audio Codec (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in diffusion and conditional flow matching models for low-resolution domains are underexplored. |
| Approach: | They propose a CFM-based model that iteratively generates raw waveform in low-bitrate conditions . they propose DVQ, a factorized quantization method that uses a single quantizer . |
| Outcome: | The proposed model outperforms state-of-the-art neural audio codecs in audio quality and semantic intelligibility under low-bitrate conditions. |