ExPerT: Personalizing LLM Responses to Users’ Domain Expertise via Query-Wise Semantic and Keystroke Behavioral Cues (2026.acl-long)
Copied to clipboard
| Challenge: | Existing personalization methods relying on static profiles or text-only signals fail to capture query-specific expertise variation. |
| Approach: | They propose a query-wise personalization framework that adapts LLM responses to query domain expertise by combining semantic and behavioral cues. |
| Outcome: | ExPerT reduces expertise inference error by 65.7% compared to the strongest baseline and improves response satisfaction by 17.52% on a 5-point Likert scale. |
Similar Papers
ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Evaluating personalized text generated by large language models is challenging, as only the LLM user, i.e. prompt author, can reliably assess the output. |
| Approach: | They propose an explainable reference-based evaluation framework that leverages an LLM to extract atomic aspects and their evidences from the generated and reference texts, match the aspects, and evaluate their alignment based on content and writing style. |
| Outcome: | The proposed framework achieves a 7.2% improvement in alignment with human judgments compared to the state-of-the-art evaluation methods. |
Personalize Your LLM: Fake it then Align it (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing personalization methods require fine-tuning of large language models for each user, rendering them prohibitively expensive for widespread adoption. |
| Approach: | They propose a retrieval-based personalization approach that uses self-generated personal preference data and representation editing to enable quick and cost-effective personalization. |
| Outcome: | The proposed approach outperforms two personalization baselines by 40% on various tasks. |
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Generating accurate SQL queries for user questions rely on the capability of large language models (LLMs) however, some knowledge is not explicitly included in the database schema and user question or has been learned by LLMs. |
| Approach: | They propose a Knowledge-to-SQL framework that employs tailored Data Expert LLM (DELLM) to provide helpful knowledge for all text-to SQL models. |
| Outcome: | The proposed framework improves the state-of-the-art approaches for text-to-SQL tasks by leveraging a data expert LLM (DELLM) to provide useful knowledge for all text- to-SqL models. |
ReasoningRec: Bridging Personalized Recommendations and Human-Interpretable Explanations through LLM Reasoning (2025.findings-naacl)
Copied to clipboard
| Challenge: | Empirical evaluations demonstrate that ReasoningRec surpasses state-of-the-art methods by up to 12.5% in recommendation prediction while simultaneously providing human-intelligible explanations. |
| Approach: | They propose a reasoning-based recommendation framework that leverages Large Language Models to model users and items, focusing on preferences, aversions, and explanatory reasoning. |
| Outcome: | The proposed framework surpasses state-of-the-art methods by up to 12.5% in recommendation prediction while providing human-intelligible explanations. |
Personalized LLM Decoding via Contrasting Personal Preference (2025.emnlp-main)
Copied to clipboard
| Challenge: | Personalization of large language models (LLMs) is becoming increasingly important as they are increasingly deployed in real-world applications. |
| Approach: | They propose a decoding-time approach that leverages the user's implicit reward signal by performing parameter-efficient fine-tuning on user-specific data. |
| Outcome: | The proposed approach improves personalization by an average of 10.57% in ROUGE-L without external reward models or additional training procedures. |
Benchmarking and Improving LLM Robustness for Personalized Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluations focus on whether a model’s responses align with a user’s preferences, but factuality is an important yet overlooked dimension. |
| Approach: | They propose a scalable framework for evaluating robustness of large language models in personalization and a new dataset, PERGData. |
| Outcome: | The proposed framework improves robustness by 25% across models. |
Personality Editing for Language Models through Adjusting Self-Referential Queries (2026.eacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are integral to conversational agents and content creation, but they lack robustness and require large-scale training data to achieve significant improvements in personality alignment. |
| Approach: | They propose a method that introduces adjustment queries where self-referential statements grounded in psychological constructs are treated analogously to factual knowledge to enable direct editing of personality-related responses. |
| Outcome: | The proposed method improves personality alignment across personality dimensions and requires only 12 editing samples to achieve significant improvements. |
Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement (2025.coling-main)
Copied to clipboard
Chenkai Sun, Ke Yang, Revanth Gangi Reddy, Yi Fung, Hou Pong Chan, Kevin Small, ChengXiang Zhai, Heng Ji
| Challenge: | Existing research has focused on enhancing the retrieval stage and optimizing the representation of the database. |
| Approach: | They propose a framework to improve generalization across task contexts and collaborative refinement to bridge knowledge gaps among users. |
| Outcome: | The proposed framework improves generalization across task contexts and collaborative refinement to bridge knowledge gaps among users. |
PANDA: Preference Adaptation for Enhancing Domain-Specific Abilities of LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models have demonstrated considerable capabilities across various tasks . however, they often fall short of the performance achieved by domain-specific state-of-the-art models . |
| Approach: | They propose a tuning-free method to augment domain-specific abilities of Large language models . they leverage insights from the response preference of expert models to augment LLMs . |
| Outcome: | The proposed method outperforms the expert model on 4 ScienceWorld tasks. |
PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits (2024.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies have shown that LLMs can generate content that aligns with their assigned personality traits, but there is limited research on whether they consistently reflect specific personality traits. |
| Approach: | They propose to study the behavior of LLM-based agents which they refer to as LLM personas and simulate them to measure their personality traits. |
| Outcome: | The proposed model is based on the Big Five personality model and has been validated by human evaluations and automatic evaluations. |