Think Again! The Effect of Test-Time Compute on Preferences, Opinions, and Beliefs of Large Language Models (2025.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models exhibit subjective preferences, opinions, and beliefs, which may shape their behavior, influence advice and recommendations, and potentially reinforce certain viewpoints. |
| Approach: | They developed a benchmark to assess LLMs’ subjective inclinations across societal, cultural, ethical, and personal domains. |
| Outcome: | The proposed benchmark assesses LLMs’ subjective inclinations across societal, cultural, ethical, and personal domains. |
Similar Papers
The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models (2024.findings-emnlp)
Copied to clipboard
Bolei Ma, Xinpeng Wang, Tiancheng Hu, Anna-Carolina Haensch, Michael Hedderich, Barbara Plank, Frauke Kreuter
| Challenge: | Recent advances in Large Language Models have sparked interest in validating human-like cognitive-behavioral traits. |
| Approach: | They examine whether LLM outputs reflect human-like cognitive-behavioral traits . they find that measuring AOVs embedded within LLMs remains opaque . |
| Outcome: | The proposed model can be used to evaluate human-like cognitive-behavioral traits . the proposed model could be used in writing assistants and other applications . |
Dissecting Human and LLM Preferences (2024.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that human and Large Language Model preferences are important for model fine-tuning and evaluation. |
| Approach: | They dissect the preferences of human and 32 different Large Language Models to understand their quantitative composition. |
| Outcome: | The proposed model is compared with 32 different large language models using real-world user-model conversations. |
Beyond the Surface: Measuring Self-Preference in LLM Judgments (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods measure self-preference bias by comparing the scores a judge model assigns to its own responses with those assigned to other models. |
| Approach: | They propose to use gold judgments as proxies for the actual quality of responses . they propose to measure self-preference bias as the difference between the judge model's own and other models' scores . |
| Outcome: | The proposed method can assess self-preference bias across large language models . it uses gold judgments as proxies for the ground truth scores of the judge model . |
How does Misinformation Affect Large Language Model Behaviors and Preferences? (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies have explored the role of Large Language Models in combating misinformation, but there is still a lack of detailed analysis on the specific aspects and extent to which LLMs are influenced by misinformation. |
| Approach: | They propose to use a benchmark to evaluate LLMs' behavior and knowledge preference toward misinformation to identify their models. |
| Outcome: | The proposed approach is based on 10,346,712 pieces of misinformation and examines knowledge conflicts and stylistic variations. |
Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses (2025.findings-emnlp)
Copied to clipboard
| Challenge: | large language models (LLMs) increasingly assist subjective decision-making . prior work uses aggregate human judgments, but demographic variation and its linguistic drivers remain underexplored. |
| Approach: | They analyze how demographic background and empathy level correlate with LLM-generated dilemma responses . they also identify markers that predict group-level differences . |
| Outcome: | The authors show that demographic background and empathy level correlate with LLM preferences . their findings highlight the need for demographically informed LLM evaluations. |
Whose Facts Win? LLM Source Preferences under Knowledge Conflicts (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on the role of the source of knowledge conflicts have not investigated the role . |
| Approach: | They propose a framework that reduces repetition bias by up to 79.2% while maintaining at least 72.5% of original preferences. |
| Outcome: | The proposed method reduces repetition bias by up to 79.2% while maintaining at least 72.5% of original preferences. |
A Monte-Carlo Sampling Framework For Reliable Evaluation of Large Language Models Using Behavioral Analysis (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to evaluation of large language models ignore high entropy of LLM responses. |
| Approach: | They propose a Monte-Carlo evaluation framework for evaluating large language models . they test multiple LLMs to see if they are susceptible to cognitive biases . |
| Outcome: | The proposed framework shows that LLMs are more human-like and less rational . it also shows that larger LLM models are more susceptible to cognitive biases . |
Do Language Models Think Consistently? A Study of Value Preferences Across Varying Response Lengths (2026.findings-acl)
Copied to clipboard
| Challenge: | In short-form surveys and psychometric tests, value-related risks and preferences are often underexplored in practical settings. |
| Approach: | They compare short-form responses to long-form outputs to determine whether value preferences align with those expressed in long-term outputs. |
| Outcome: | The proposed method yields only modest gains in the consistency of value expression. |
On Generalization across Measurement Systems: LLMs Entail More Test-Time Compute for Underrepresented Cultures (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) should be able to provide accurate information irrespective of the measurement system at hand . |
| Approach: | They use newly compiled datasets to test if this is true for seven open-source LLMs. |
| Outcome: | The proposed model can provide accurate information regardless of the measurement system at hand. |
Biased LLMs can Influence Political Decision-Making (2025.acl-long)
Copied to clipboard
Jillian Fisher, Shangbin Feng, Robert Aron, Thomas Richardson, Yejin Choi, Daniel W Fisher, Jennifer Pan, Yulia Tsvetkov, Katharina Reinecke
| Challenge: | Recent studies have found that biased LLMs can influence decisions in areas such as medical classifications and educational hiring. |
| Approach: | They conducted two interactive experiments on partisan bias in large language models while completing tasks with either a biased liberal, biased conservative, or unbiased control model. |
| Outcome: | The results show that prior knowledge of AI is weakly correlated with a reduction of the bias, suggesting that AI education can be crucial for mitigating bias effects. |