Challenge: Existing studies on controllable text generation focus on controlling attributes such as sentiment, writing style, and writing style.
Approach: They introduce a metric that quantifies semantic diversity for scenario generation under fixed abstract semantic constraints and validate it through controlled experiments.
Outcome: The proposed metric achieves excellent discrimination accuracy (100% and 91.9%, respectively), with discriminative power up to 5.5 greater than the best baseline.

Similar Papers

Measuring Lexical Diversity of Synthetic Data Generated through Fine-Grained Persona Prompting (2025.findings-emnlp)

Copied to clipboard

Challenge: Fine-grained personas have been used for generating ‘diverse’ synthetic data for pre-training and supervised fine-tuning of Large Language Models (LLMs).
Approach: They measure the diversity of persona-driven synthetically generated prompts and responses with a suite of lexical diversity and redundancy metrics.
Outcome: The proposed model is based on human-written prompts and responses, but human-generated prompts are significantly less diverse than human-created ones.
Generating Diverse Story Continuations with Controllable Semantics (D19-56)

Copied to clipboard

Challenge: a new framework for controllable story continuation generation is proposed . we use frames to generate story continuations based on sentence attributes .
Approach: They propose a framework for controlled generation of multiple, diverse outputs . they use sentiment, length, predicates, frames, and automatically-induced clusters as controllable dimensions .
Outcome: The proposed model produces outputs that match target attributes, the authors show . it also yields higher metric scores than previous models, they show ."
How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Code (2025.findings-emnlp)

Copied to clipboard

Challenge: Language models (LMs) have exhibited impressive abilities in generating code from natural language requirements.
Approach: They propose to introduce various metrics with inter-code similarity to evaluate the diversity of generated code by comparing model-generated solutions with human-written ones.
Outcome: The proposed method leverages LMs’ capabilities in code understanding and reasoning, resulting in a set of metrics that represent the number of algorithms in model-generated solutions.
Continuous Context Sampling Allows Extending Diversity Boundaries of Large Language Models (2026.acl-srw)

Copied to clipboard

Challenge: Large language models exhibit a persistent limitation: repeated generations from the same prompt tend to be semantically similar.
Approach: They propose to construct a conditioning distribution from a small set of diverse anchor generations and use it to condition an LLM's generation distribution.
Outcome: The proposed framework significantly expands the model's reachable semantic range by constructing a conditioning distribution from a small set of diverse anchor generations.
Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown proficiency in enhancing the generation quality across various tasks without the need for any fine-tuning.
Approach: They propose a method that diversifies the LLM generations while preserving their quality.
Outcome: The proposed method can be used as training data to improve diversity in existing commonsense generators.
BIASEDTALES-ML: A Multilingual Dataset for Analyzing Narrative Attribute Distributions in LLM-Generated Stories (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on the use of Large Language Models (LLMs) focus primarily on English, leaving the cross-lingual generalization of aligned behavior underexplored.
Approach: They propose a structured generator-extractor pipeline and a multi-dimensional distributional analysis framework to examine how narrative attributes vary across languages, models, and social conditions.
Outcome: The proposed model reveals substantial cross-lingual variability in narrative generation patterns, indicating that distributions observed in English do not always exhibit similar characteristics in other languages, particularly in lower-resource settings.
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Existing pre-trained large language models have shown unparalleled generative capabilities, but they are not controllable.
Approach: They propose a framework that uses large-scale language models and adds control to text generation by incorporating an external knowledge base.
Outcome: The proposed model generates more fluent, consistent, and coherent stories with less repetition and higher diversity compared to previous work on the ROC story dataset.
G2: Guided Generation for Enhanced Output Diversity in LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to enhance output diversity but compromise quality of outputs.
Approach: They propose a training-free plug-and-play method that enhances output diversity while preserving generation quality.
Outcome: The proposed method enhances output diversity while maintaining an optimal balance between diversity and quality.
Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventions (2023.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) can be used to generate text data for training and evaluating other models.
Approach: They propose to use logit suppression and temperature sampling to diversify text generation but at the cost of data accuracy.
Outcome: The proposed approach can increase diversity but at the cost of data accuracy.
Style over Story: Measuring LLM Narrative Preferences via Structured Selection (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies show that large language models encode preference-related signatures, including political preferences, personality traits, and value correlations.
Approach: They propose a constraint-selection-based experiment for measuring narrative preferences of Large Language Models by eliciting choices among narrative constraints when alternatives are explicitly specified.
Outcome: The proposed model prioritizes Style over content elements like Event, Character, and Setting.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations