Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs (2024.findings-acl)
Copied to clipboard
| Challenge: | Controlled Text Generation (CTG) aims to produce texts that exhibit specific desired attributes. |
| Approach: | They propose a pluggable CTG framework for Large Language Models to control text . they use attribute scorers to evaluate attributes of sentences and construct dynamic attribute graphs . |
| Outcome: | The proposed framework achieves a peak improvement of 19.29% over baseline methods in two tasks. |
Similar Papers
Tailor: A Soft-Prompt-Based Approach to Attribute-Based Controlled Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work focuses on generating sentences satisfying pre-specified attributes such as topic and sentiment, yet suffers from increases in storage and inference time. |
| Approach: | They propose a method that uses a pre-trained continuous vector to generate a fixed pre-trainable language model to satisfy a specified attribute. |
| Outcome: | The proposed model can achieve improvements on eleven attribute-specific generation tasks with 0.08% extra training parameters. |
TARA: Token-level Attribute Relation Adaptation for Multi-Attribute Controllable Text Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on multi-attribute controllable text generation ignores interrelations of attributes . recent work defines attribute relations as promotive, but not fixed . |
| Approach: | They propose a method that explicitly defines attribute relations as inhibtory for multi-attribute CTG . they propose 'tara' which employs token-level attribute relation adaptation and representation to generate text with the balanced multi-attribut . |
| Outcome: | The proposed method generates text with the balanced multi-attribute control. |
Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Controllable text generation (CTG) aims to generate text with desired attributes, but current methods lack high levels of controllability. |
| Approach: | They propose a lightweight decoding framework that reconstructs attribute distributions to balance the weights between attribute words and non-attribute words to generate more fluent text. |
| Outcome: | The proposed framework achieves state-of-the-art control performance on multiple CTG tasks. |
Controlled Transformation of Text-Attributed Graphs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Graph generation is the process of generating new graphs with similar attributes to real world graphs. |
| Approach: | They propose a controllable multi-objective translation model for text-attributed graphs that can translate a given source graph to a target graph while satisfying multiple desired graph attributes at granular level. |
| Outcome: | The proposed model can translate a given source graph to a target graph while satisfying multiple desired graph attributes at granular level. |
Continual Reinforcement Learning for Controlled Text Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Controlled Text Generation (CTG) aims to steer text generation towards texts possessing a desired attribute. |
| Approach: | They propose an algorithm that steers the generation of continuations of a given context . they propose a Continual Learning problem to learn at every step to steer next-word generation . |
| Outcome: | The proposed algorithm is based on a plug-and-play language model and exhibits promising results. |
Attribute Controlled Fine-tuning for Large Language Models: A Case Study on Detoxification (2024.findings-emnlp)
Copied to clipboard
Tao Meng, Ninareh Mehrabi, Palash Goyal, Anil Ramakrishna, Aram Galstyan, Richard Zemel, Kai-Wei Chang, Rahul Gupta, Charith Peris
| Challenge: | Using a sequence-level constraint, we regularize the LLMtraining by penalizing the KL divergence between the desired output distribution and the LRM’s posterior. |
| Approach: | They propose a constraint learning schema forfine-tuning Large Language Models with attribute control by penalizing the KL divergence be-tween the desired output distribution and the LLM's posterior. |
| Outcome: | The proposed approach improves the performance of large language models while enhancing their utility and generation quality. |
Targeted Data Generation: Finding and Fixing Model Weaknesses (2023.acl-long)
Copied to clipboard
| Challenge: | Existing models fail systematically on specific subgroups of data, resulting in unfair outcomes and eroding user trust. |
| Approach: | They propose a framework that automatically identifies challenging subgroups and generates new data for those subgroup using large language models with a human in the loop. |
| Outcome: | The proposed framework improves accuracy on challenging subgroups while improving overall test accuracy. |
TaKG: A New Dataset for Paragraph-level Table-to-Text Generation Enhanced with Knowledge Graphs (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing table-to-text generation benchmarks have some limitations, such as E2E and ToTTo focusing on singlesentence generation tasks. |
| Approach: | They propose a new table-to-text generation dataset called TaKG that uses a set of knowledge graphs to enhance table input. |
| Outcome: | The proposed model outperforms existing models for short-text generation tasks and shows reliable performance on long-text generated across a variety of metrics. |
Attribute Alignment: Controlling Text Generation from Pre-trained Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models can generate text with sentiment polarity or specific topics without changing the original model parameters. |
| Approach: | They propose a method for controlling text generation by aligning disentangled attribute representations. |
| Outcome: | The proposed method shows large performance gains while maintaining diversity and fluency. |
RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation Framework (2024.emnlp-main)
Copied to clipboard
| Challenge: | RSA-Control is a training-free controllable text generation framework . existing studies rely on fine-tuning pre-trained language models . external components could hurt coherence and accuracy of the model . |
| Approach: | They propose a training-free controllable text generation framework grounded in pragmatics that directs the generation process by recursively reasoning between imaginary speakers and listeners. |
| Outcome: | The proposed framework achieves strong attribute control while maintaining fluency and content consistency. |