A Distributional Lens for Multi-Aspect Controllable Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for multi-aspect control suffer from attribute degeneration due to mutual interference of these controllers. |
| Approach: | They propose to use attribute fusion to find the intersections of multiple attributes as their combination for generation. |
| Outcome: | The proposed method outperforms baselines on attribute relevance and text quality and achieves the SOTA. |
Similar Papers
Multi-Attribute Controlled Text Generation with Contrastive-Generator and External-Discriminator (2022.coling-1)
Copied to clipboard
| Challenge: | Existing studies on controlled text generation focus on single-attribute control, but in practical applications, they lack controllability. |
| Approach: | They propose a framework for multi-attribute controlled text generation that can effectively generate texts with more attributes. |
| Outcome: | The proposed framework achieves remarkable controllability while keeping the text fluent and diverse. |
Multi-Aspect Controllable Text Generation with Disentangled Counterfactual Augmentation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies neglect attribute correlations formed by the intertwining of different attributes. |
| Approach: | They propose a multi-aspect controllable text generation method with disentangled counterfactual augmentation that alleviates imbalanced attribute correlations during training by disentanglement. |
| Outcome: | The proposed method outperforms state-of-the-art methods in imbalanced and balanced attribute correlation scenarios. |
Exploring Controllable Text Generation Techniques (2020.coling-main)
Copied to clipboard
| Challenge: | Neural controllable text generation has a plethora of applications but there is no unifying theme. |
| Approach: | They propose a new schema for the control of attributes in the generation process by classifying it into five modules and providing an analysis on the advantages and disadvantages of these techniques. |
| Outcome: | The proposed frameworks can be used to control the attributes of natural sentences and to modulate the formality and politeness of emails. |
MacLaSa: Multi-Aspect Controllable Text Generation via Efficient Sampling from Compact Latent Space (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to multi-aspect controllable text generation require expensive iteration / searching within the discrete text space during the decoding stage, resulting in a degradation of text quality due to the domain discrepancies between different aspects. |
| Approach: | They propose a framework that estimates compact latent space for multiple aspects and performs efficient Sampling with a fast sampler to eliminate domain discrepancies. |
| Outcome: | The proposed framework outperforms baselines on attribute relevance and textual quality while maintaining a high inference speed. |
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Multi-aspect controllable text generation has attracted increasing attention . but the mutual interference of multiple prefixes limits its extensibility to training-time unseen combinations. |
| Approach: | They propose to use trainable gates to normalize the intervention of prefixes to restrain the interference. |
| Outcome: | The proposed approach outperforms baselines on constraint accuracy, text quality, and extensibility. |
Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Controllable text generation (CTG) aims to generate text with desired attributes, but current methods lack high levels of controllability. |
| Approach: | They propose a lightweight decoding framework that reconstructs attribute distributions to balance the weights between attribute words and non-attribute words to generate more fluent text. |
| Outcome: | The proposed framework achieves state-of-the-art control performance on multiple CTG tasks. |
Attribute Alignment: Controlling Text Generation from Pre-trained Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models can generate text with sentiment polarity or specific topics without changing the original model parameters. |
| Approach: | They propose a method for controlling text generation by aligning disentangled attribute representations. |
| Outcome: | The proposed method shows large performance gains while maintaining diversity and fluency. |
TARA: Token-level Attribute Relation Adaptation for Multi-Attribute Controllable Text Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on multi-attribute controllable text generation ignores interrelations of attributes . recent work defines attribute relations as promotive, but not fixed . |
| Approach: | They propose a method that explicitly defines attribute relations as inhibtory for multi-attribute CTG . they propose 'tara' which employs token-level attribute relation adaptation and representation to generate text with the balanced multi-attribut . |
| Outcome: | The proposed method generates text with the balanced multi-attribute control. |
Benchmarking and Improving Compositional Generalization of Multi-aspect Controllable Text Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing MCTG methods face a noticeable performance drop in compositional testing. |
| Approach: | They propose a benchmark to evaluate compositional generalization of MCTG methods by combining multi-aspect labeled datasets and a crafted three-dimensional evaluation protocol. |
| Outcome: | The proposed framework improves compositional generalization performance by 3.64% and 94.4% in compositional testing. |
An Invariant Learning Characterization of Controlled Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Controlled generation is a problem of creating text that contains stylistic or semantic attributes of interest. |
| Approach: | They propose a distribution shift-based control system that can be used to train a predictor of the desired attribute. |
| Outcome: | The proposed method shows that the most effective predictor should be invariant across multiple text environments. |