Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas (2025.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that LLMs can't tailor outputs to users with uncommon preferences . despite the success of persona inference, we may need debiasing and abstention. |
| Approach: | They propose to use preference data to infer needs and interests of users who prefer either output . they argue that training on preference data augmented with PI boosts personalization . |
| Outcome: | The proposed method can be used to improve personalization with less privacy concerns. |
Similar Papers
Group Preference Alignment: Customizing LLM Responses from In-Situ Conversations Only When Needed (2025.emnlp-industry)
Copied to clipboard
Ishani Mondal, Jack W. Stokes, Sujay Kumar Jauhar, Longqi Yang, Mengting Wan, Xiaofeng Xu, Xia Song, Jordan Lee Boyd-Graber, Jennifer Neville
| Challenge: | Existing methods for group-aware adaptation capture divergent preferences from real-world conversation logs into interpretable rubrics. |
| Approach: | They propose a group-aware personalization framework that captures context-specific preferences and steers LLMs accordingly. |
| Outcome: | The proposed framework improves group alignment without compromising perfomance on benchmarks. |
From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Current approaches to align large language models assume uniform human preferences, overlooking the diversity inherent in human populations. |
| Approach: | They propose a framework for scalable personalized alignment of large language models . they establish a preference space characterizing psychological and behavioral dimensions . |
| Outcome: | The proposed framework improves on existing methods with an average of 17.06% accuracy gain across four benchmarks and a strong adaptation capability to novel preferences. |
Dissecting Human and LLM Preferences (2024.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that human and Large Language Model preferences are important for model fine-tuning and evaluation. |
| Approach: | They dissect the preferences of human and 32 different Large Language Models to understand their quantitative composition. |
| Outcome: | The proposed model is compared with 32 different large language models using real-world user-model conversations. |
GRAVITY: A Framework for Personalized Text Generation via Profile-Grounded Synthetic Preferences (2026.eacl-long)
Copied to clipboard
| Challenge: | Personalization in LLMs often relies on costly human feedback or interaction logs, limiting scalability and neglecting deeper user attributes. |
| Approach: | They propose a framework for generating synthetic, profile-grounded preference data that captures users’ interests, values, beliefs, and personality traits. |
| Outcome: | The proposed framework improves on book descriptions for 400 Amazon users across multiple cultures, with user studies showing that outputs are preferred over 86% of the time. |
FaST: Feature-aware Sampling and Tuning for Personalized Preference Alignment with Limited Data (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on personalizing conversational assistants to meet specific user preferences. |
| Approach: | They propose to use a dataset to analyze a problem where only a small set of preference annotations can be collected per user. |
| Outcome: | The proposed approach leverages high-level features discovered from the data, achieving the best overall performance. |
Personalize Your LLM: Fake it then Align it (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing personalization methods require fine-tuning of large language models for each user, rendering them prohibitively expensive for widespread adoption. |
| Approach: | They propose a retrieval-based personalization approach that uses self-generated personal preference data and representation editing to enable quick and cost-effective personalization. |
| Outcome: | The proposed approach outperforms two personalization baselines by 40% on various tasks. |
Mirroring Users: Towards Building Preference-aligned User Simulator with User Feedback in Recommendation (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models lack specific task alignment and large-scale simulations are challenging due to their ambiguity, noise and massive volume. |
| Approach: | They propose a framework that leverages user feedback in RSs with advanced LLM capabilities to generate high-quality simulation data. |
| Outcome: | The proposed framework boosts the alignment with human preferences and in-domain reasoning capabilities of the fine-tuned LLMs. |
A Systematic Examination of Preference Learning through the Lens of Instruction-Following (2025.naacl-long)
Copied to clipboard
Joongwon Kim, Anirudh Goyal, Aston Zhang, Bo Xiong, Rui Hou, Melanie Kambadur, Dhruv Mahajan, Hannaneh Hajishirzi, Liang Tan
| Challenge: | a recent study has found that preference learning is a key tool for enhancing LLM training and alignment. |
| Approach: | They use a synthetic data generation pipeline to generate 48,000 unique instruction-following prompts with 23 verifiable constraints to obtain preference pairs. |
| Outcome: | The proposed pipeline generates 48,000 unique instruction-following prompts with 23 verifiable constraints that enable fine-grained and automated quality assessments of model responses. |
When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Reinforcement Learning from Human Feedback assumes homogeneous preferences across users . personalization can introduce up to 20% safety misalignment . |
| Approach: | They propose a framework to assess personalized preference learning by tailoring preferences for users . they compare eight personalization methods across three preference datasets . |
| Outcome: | The proposed framework measures performance, fairness, unintended effects, adaptability across preferences . performance differences between personalization methods could reach 36% when users strongly disagree . |
Aligning LLMs with Individual Preferences via Interaction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies on LLMs alignment focus on generalizing their behavior to generalized values such as helpfulness, harmlessness, and honesty. |
| Approach: | They train large language models to "interact to align" to implicitly infer user preferences . they use a multi-turn preference dataset to generate a personalized alignment . |
| Outcome: | The proposed method enables dynamic, personalized alignment via interaction with a multi-turn preference dataset. |