Challenge: Existing approaches to control text generation (CTG) are essentially challenging to adapt to various control objectives and constraints, which results in mixed success.
Approach: They propose a unified controllable text generation framework which integrates a control module, a prompt module, and a generation module.
Outcome: The proposed framework significantly improves query accuracy and coherence in tasks with different objectives and constraints.

Similar Papers

Automatic and Human-AI Interactive Text Generation (with a focus on Text Simplification and Revision) (2024.acl-tutorials)

Copied to clipboard

Challenge: In this tutorial, we focus on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and then generates a revision that is improved according to some specific criteria.
Approach: This tutorial focuses on text-to-text generation, a class of natural language generation tasks that takes a piece of text as input and generates a revision that is improved according to some specific criteria.
Outcome: This tutorial focuses on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and generates a revision that is improved according to some specificcriteria.
Control Large Language Models via Divide and Conquer (2024.emnlp-main)

Copied to clipboard

Challenge: Lexically Constrained Generation (LCG) is a crucial task of text generation.
Approach: They propose a Divide and Conquer Generation strategy to enhance LLMs' performance in Lexically Constrained Generation with prompt-based controlling.
Outcome: The proposed strategy shows 90% improvement on the most challenging LCG task.
Uniform Complexity for Text Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing models do not capture factors that contribute to producing consistent text.
Approach: They propose a benchmark test to evaluate text complexity in generative models by observing linguistic properties of input prompts.
Outcome: The proposed model fails to preserve complexity of input prompts even if finetuned with professionally written texts.
Exploring Controllable Text Generation Techniques (2020.coling-main)

Copied to clipboard

Challenge: Neural controllable text generation has a plethora of applications but there is no unifying theme.
Approach: They propose a new schema for the control of attributes in the generation process by classifying it into five modules and providing an analysis on the advantages and disadvantages of these techniques.
Outcome: The proposed frameworks can be used to control the attributes of natural sentences and to modulate the formality and politeness of emails.
Language Model Sentence Completion with a Parser-Driven Rhetorical Control Method (2024.eacl-short)

Copied to clipboard

Challenge: Large Language Models (LLMs) generate nonfacts and deviate from desired criteria for text generation.
Approach: They propose a controlled text generation algorithm that enforces adherence toward specific rhetorical relations in an LLM sentence-completion context by a parser-driven decoding scheme.
Outcome: The proposed method generates sentences that satisfy desired rhetorical relations in an LLM.
SGG: Learning to Select, Guide, and Generate for Keyphrase Generation (2021.naacl-main)

Copied to clipboard

Challenge: Existing keyphrase generation approaches synchronously generate present and absent keyphrases without explicitly distinguishing these two categories.
Approach: They propose to deal with present and absent keyphrases separately with different mechanisms by using a hierarchical neural network with a pointing-based selector and a selection-guided generator.
Outcome: The proposed model outperforms baselines on four keyphrase generation tasks and shows extensibility in natural language generation tasks.
Tailor: A Soft-Prompt-Based Approach to Attribute-Based Controlled Text Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing work focuses on generating sentences satisfying pre-specified attributes such as topic and sentiment, yet suffers from increases in storage and inference time.
Approach: They propose a method that uses a pre-trained continuous vector to generate a fixed pre-trainable language model to satisfy a specified attribute.
Outcome: The proposed model can achieve improvements on eleven attribute-specific generation tasks with 0.08% extra training parameters.
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue (D19-1)

Copied to clipboard

Challenge: Existing methods to generate natural language for task-oriented dialogues lack naturalness and variation in language.
Approach: They propose a multi-task learning framework for natural language generation that explicitly targets for naturalness in generated responses via an unconditioned language model.
Outcome: The proposed framework outperforms existing models across multiple datasets in the study of natural language generation.
Controlled Language Generation for Language Learning Items (2022.emnlp-industry)

Copied to clipboard

Challenge: Recent advances in pre-trained language models have resulted in success in generating fluent English text.
Approach: They propose to employ natural language generation to rapidly generate English language items . they experiment with deep pretrained models and develop methods for controlling items for factors relevant in language learning .
Outcome: The proposed framework shows high grammatically scores for all models and higher complexity over baseline models.
Sentence Smith: Controllable Edits for Evaluating Text Embeddings (2025.emnlp-main)

Copied to clipboard

Challenge: Controllable and transparent text generation has been a long-standing goal in NLP . but previous approaches were hindered by parsing and generation insufficiencies .
Approach: They propose a framework for English that has three steps: 1. Parsing a sentence into a semantic graph. 2. Applying human-designed semantic manipulation rules. 3. Generating text from the manipulated graph.
Outcome: The proposed framework for English is based on a neural network and parsers.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations