| Challenge: | Generative Adversarial Networks (GANs) do not suffer from the problem of exposure bias. |
| Approach: | They propose to approximate the distribution of text generated by a GAN and compare it to traditional probability-based LM metrics. |
| Outcome: | The proposed method performs significantly worse than state-of-the-art LMs on several GAN-based models and can accelerate progress in GAN text generation. |
Similar Papers
Making Use of Latent Space in Language GANs for Generating Diverse Text without Pre-training (2021.eacl-srw)
Copied to clipboard
| Challenge: | Existing models for generating diverse texts are not pre-trained . generative adversarial networks suffer from mode-collapsing if they are not trained . |
| Approach: | They propose a GAN model that produces diverse texts conditioned by latent code . they propose to use Gumbel-Softmax distribution for word sampling . |
| Outcome: | The proposed model is competitive with existing models, which requires pre-training. |
Latent Code and Text-based Generative Adversarial Networks for Soft-text Generation (N19-1)
Copied to clipboard
| Challenge: | Text generation with generative adversarial networks (GANs) can be divided into text-based and code-based categories depending on the type of signals used for discrimination. |
| Approach: | They propose a text-based approach to exploit generative adversarial networks (GANs) by using autoencoders to provide a continuous representation of sentences, which they will refer to as soft-text, and hybrid latent code and text-oriented approaches with one or more discriminators. |
| Outcome: | The proposed approach outperforms the traditional GAN-based methods on two well-known datasets. |
A Preliminary Exploration of GANs for Keyphrase Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on extractive keyphrases have shown promising results, but the results suggest that there is room for improvement. |
| Approach: | They propose a new keyphrase generation approach using Generative Adversarial Networks (GANs) their model produces a sequence of keyphrases and a discriminator distinguishes between human-curated and machine-generated keyphrase. |
| Outcome: | The proposed model outperforms the state-of-the-art generative models on benchmark datasets and is comparable to the best performing extractive models. |
Diversity-Promoting GAN: A Cross-Entropy Based Generative Adversarial Network for Diversified Text Generation (D18-1)
Copied to clipboard
| Challenge: | Existing text generation methods tend to produce repeated and ”boring” expressions. |
| Approach: | They propose a model that assigns low reward for repeatedly generated text and high reward for ”novel” and fluent text, and a novel language-model based discriminator which can distinguish novel text from repeated text without the saturation problem. |
| Outcome: | The proposed model generates more diverse and informative text than existing baselines on review generation and dialogue generation tasks. |
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges (2024.emnlp-main)
Copied to clipboard
| Challenge: | introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance. |
| Approach: | They propose a taxonomy for organizing existing LLM-based evaluation metrics and a structured framework to understand and compare them. |
| Outcome: | The proposed taxonomy offers a framework to understand and compare LLM-based evaluation methods. |
Judge the Judges: A Large-Scale Evaluation Study of Neural Language Models for Online Review Generation (D19-1)
Copied to clipboard
| Challenge: | Existing evaluation methods for natural language generation are inadequate . distinguishing machine-generated text is challenging even for human evaluators . |
| Approach: | They compare human-based evaluators with automated evaluation procedures . they find human evaluers do not correlate well with discriminative evalators . |
| Outcome: | The proposed evaluation methods are compared with a dozen state-of-the-art generators for online product reviews. |
MALLM-GAN: Multi-Agent Large Language Model as Generative Adversarial Network for Synthesizing Tabular Data (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing models for tabular data generation require large amounts of data to train effectively. |
| Approach: | They propose a framework to generate tabular data powered by large language models that emulates a Generative Adversarial Network. |
| Outcome: | The proposed framework outperforms state-of-the-art models while keeping privacy of real data. |
Generating Text through Adversarial Training Using Skip-Thought Vectors (N19-3)
Copied to clipboard
| Challenge: | Existing approaches to use word embeddings for text generation have been limited. |
| Approach: | They propose to use GANs with word embeddings to reproduce writing style in text . they use a sentence embeddable vector to model people's way of expression . |
| Outcome: | The proposed model outperforms baseline text generation networks across several metrics including BLEU-n, METEOR and ROUGE. |
An Empirical Study of Generating Texts for Search Engine Advertising (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing studies on neural language generation have not evaluated the effect of generated ads with actual serving included because it requires a large amount of training data and a particular environment. |
| Approach: | They propose to integrate a reinforcement learning framework into an end-to-end sequence-tosequence (Seq2S) model and demonstrate how to improve the ads’ impact, deploy models to a product, and evaluate the generated ads. |
| Outcome: | The proposed method improves the ads’ impact, deploys the models to a product, and evaluates the generated ads. |
A Tutorial on Evaluation Metrics used in Natural Language Generation (2021.naacl-tutorials)
Copied to clipboard
| Challenge: | This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field. |
| Approach: | This tutorial presents the evolution of automatic evaluation metrics to their current state . it aims to assess the extent of scientific progress made and identify areas/components that need improvement . |
| Outcome: | This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field. |