Papers by Dongmin Choi
Value Portrait: Assessing Language Models’ Values through Psychometrically and Ecologically Valid Items (2025.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks rely on human annotations that are vulnerable to value-related biases. |
| Approach: | They propose a value portrait benchmark that uses items that capture real-life user-LLM interactions and a rated item based on its similarity to their own thoughts to determine reliability. |
| Outcome: | The proposed framework improves the relevance of assessment results to real-world LLM usage by allowing human subjects to rate items with similarity to their own thoughts and derived correlations between these ratings and the subjects’ actual value scores. |
PVP: An Image Dataset for Personalized Visual Persuasion with Persuasion Strategies, Viewer Characteristics, and Persuasiveness Ratings (2025.acl-long)
Copied to clipboard
| Challenge: | Visual persuasion uses visual elements to influence cognition and behaviors . lack of comprehensive data sets connect persuasiveness of images with personal information . |
| Approach: | They propose to use a dataset to connect persuasiveness with personal information . they find psychological characteristics enhance the generation and evaluation of persuasive images . |
| Outcome: | The proposed dataset provides persuasiveness scores of images evaluated by human annotators along with demographic and psychological characteristics. |