Personalized Text Generation with Contrastive Activation Steering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to personalized text generation rely on retrieval-augmented generation and parameter-efficient fine-tuning. |
| Approach: | They propose a training-free framework that disentangles and represents personalized writing style as a vector in LLM’s activation-space. |
| Outcome: | The proposed framework achieves 8% relative improvement in personalized generation while reducing storage requirements by 1700 over PEFT method. |
Similar Papers
Style Vectors for Steering Generative Large Language Models (2024.findings-eacl)
Copied to clipboard
Kai Konen, Sophie Jentzsch, Diaoulé Diallo, Peer Schütt, Oliver Bensch, Roxanne El Baff, Dominik Opitz, Tobias Hecking
| Challenge: | Large language models (LLMs) can be trained on vast corpora and can generate text in a nuanced and parameterisable way. |
| Approach: | They propose to add style vectors to the activations of hidden layers during text generation to steer output towards specific styles. |
| Outcome: | The proposed approach differs from prompt engineering in that it can be nuanced and parameterisable. |
Steering Large Language Models for Machine Translation Personalization (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent advances in interpretability research have highlighted the effectiveness of steering methods for MT personalization. |
| Approach: | They examine steering strategies for personalizing automatic translations when few examples are available. |
| Outcome: | The proposed steering methods yield higher inference-time computational efficiency than prompting approaches. |
Efficient Layer-wise LLM Fine-tuning for Revision Intention Prediction (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models have shown extraordinary success across text generation tasks . however, their potential for simple yet essential text classification remains underexplored . |
| Approach: | a plug-and-play layer-wise parameter-efficient fine-tuning framework is proposed . it fine- tunes a subset of important LLM layers while freezing redundant ones . |
| Outcome: | a plug-and-play framework fine-tunes a subset of important LLM layers while freezing redundant layers. |
Personalized LLM Decoding via Contrasting Personal Preference (2025.emnlp-main)
Copied to clipboard
| Challenge: | Personalization of large language models (LLMs) is becoming increasingly important as they are increasingly deployed in real-world applications. |
| Approach: | They propose a decoding-time approach that leverages the user's implicit reward signal by performing parameter-efficient fine-tuning on user-specific data. |
| Outcome: | The proposed approach improves personalization by an average of 10.57% in ROUGE-L without external reward models or additional training procedures. |
Intention-Adaptive LLM Fine-Tuning for Text Revision Generation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing work on large language models (LLMs) has demonstrated impressive capabilities in context-based text generation tasks, such as summarization and reasoning. |
| Approach: | They propose an intention-adaptive layer-wise LLM fine-tuning framework that dynamically selects a subset of LLM layers to learn intentions and transfers them to revision generation. |
| Outcome: | The proposed framework outperforms PEFT baselines on small revision corpora while maintaining fast convergence and accuracy. |
Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results demonstrate that OPPU significantly outperforms existing prompt-based methods across seven diverse tasks in the LaMP benchmark. |
| Approach: | They propose to integrate parametric user knowledge into the personal PEFT parameters and non-parametric knowledge from retrieval and profiles, adapting LLMs to user behavior shifts. |
| Outcome: | The proposed method outperforms existing prompt-based methods across seven diverse tasks in the LaMP benchmark. |
GRAVITY: A Framework for Personalized Text Generation via Profile-Grounded Synthetic Preferences (2026.eacl-long)
Copied to clipboard
| Challenge: | Personalization in LLMs often relies on costly human feedback or interaction logs, limiting scalability and neglecting deeper user attributes. |
| Approach: | They propose a framework for generating synthetic, profile-grounded preference data that captures users’ interests, values, beliefs, and personality traits. |
| Outcome: | The proposed framework improves on book descriptions for 400 Amazon users across multiple cultures, with user studies showing that outputs are preferred over 86% of the time. |
Systematic Knowledge Injection into Large Language Models via Diverse Augmentation for Domain-Specific RAG (2025.findings-naacl)
Copied to clipboard
Kushagra Bhushan, Yatin Nandwani, Dinesh Khandelwal, Sonam Gupta, Gaurav Pandey, Dinesh Raghu, Sachindra Joshi
| Challenge: | Retrieval-Augmented Generation (RAG) enhances response relevance by incorporating retrieved domain knowledge in the context, retrieval errors can still lead to hallucinations and incorrect answers. |
| Approach: | They propose a framework that augments the learning process by context augmentation and knowledge paraphrasing by incorporating retrieved domain knowledge into the context. |
| Outcome: | The proposed framework achieves 10% relative gain in token-level recall while preserving the LLM’s generalization capabilities. |
Stylized Text Generation: Approaches and Applications (2020.acl-tutorials)
Copied to clipboard
| Challenge: | Text generation has played an important role in various applications of natural language processing. |
| Approach: | They present different settings of stylized text generation and introduce machine learning methods to represent style. |
| Outcome: | This paper presents a comprehensive literature review on stylized text generation . it focuses on the challenges and future directions of stylized generation based on machine learning . |
Latent Inter-User Difference Modeling for LLM Personalization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly integrated into users’ daily lives, leading to a growing demand for personalized outputs. |
| Approach: | They propose a framework that models inter-user differences in the latent space instead of relying on language-based prompts. |
| Outcome: | The proposed framework outperforms baseline methods on personalized review generation. |