How Susceptible are Large Language Models to Ideological Manipulation? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have the potential to exert substantial influence on public perceptions and interactions with information. |
| Approach: | They examine how LLMs can learn and generalize ideological biases from their instruction-tuning data. |
| Outcome: | The LLMs show a startling ability to absorb ideology from one topic and generalize it to even unrelated ones. |
Similar Papers
Biased LLMs can Influence Political Decision-Making (2025.acl-long)
Copied to clipboard
Jillian Fisher, Shangbin Feng, Robert Aron, Thomas Richardson, Yejin Choi, Daniel W Fisher, Jennifer Pan, Yulia Tsvetkov, Katharina Reinecke
| Challenge: | Recent studies have found that biased LLMs can influence decisions in areas such as medical classifications and educational hiring. |
| Approach: | They conducted two interactive experiments on partisan bias in large language models while completing tasks with either a biased liberal, biased conservative, or unbiased control model. |
| Outcome: | The results show that prior knowledge of AI is weakly correlated with a reduction of the bias, suggesting that AI education can be crucial for mitigating bias effects. |
Probing Political Ideology in Large Language Models: How Latent Political Representations Generalize Across Tasks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models encode rich internal representations of political ideology, but it remains unclear how these representations contribute to model decision-making. |
| Approach: | They apply inference-time interventions to steer a decoder-only transformer along learned ideological directions . they find that learned ideological representations generalize well to bias detection, but not as well to voting simulations . |
| Outcome: | The proposed model steers a transformer along learned ideological directions . political bias detection, voting preference simulation and bias neutralization are tested . |
Bias in the Mirror : Are LLMs opinions robust to their own adversarial attacks (2025.acl-long)
Copied to clipboard
| Challenge: | Existing work on large language models lacks robustness, highlighting the limitations of such models. |
| Approach: | They propose a novel approach where two LLMs engage in self-debate to persuade a neutral version of the model. |
| Outcome: | The proposed approach examines whether large language models are robust during interactions and whether they are susceptible to reinforcing misinformation or shifting to harmful viewpoints. |
Understanding Large Language Model Vulnerabilities to Social Bias Attacks (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable linguistic capabilities across tasks . however, there is a growing concern about their potential to perpetuate social biases . |
| Approach: | They evaluate LLMs across gender, racial, and religious bias types . they also explore cross-bias and multiple-biases attacks . |
| Outcome: | The proposed models are more susceptible to gender bias attacks than racial or religious biases. |
Systematic Biases in LLM Simulations of Debates (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current research suggests that LLM-based agents become increasingly human-like in their performance, sparking interest in using these AI agents as substitutes for human participants in behavioral studies. |
| Approach: | They propose to use LLMs to simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
| Outcome: | The proposed model can simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
Combating Security and Privacy Issues in the Era of Large Language Models (2024.naacl-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to provide a summary of risks and vulnerabilities in large language models . a number of studies have focused on security, privacy and copyright aspects of LLMs . |
| Approach: | This tutorial seeks to provide a systematic summary of risks and vulnerabilities in large language models . authors will discuss security, privacy and copyright aspects of LLMs . |
| Outcome: | This tutorial aims to provide a systematic summary of risks and vulnerabilities in large language models . it will also outline emerging challenges in security, privacy and reliability of LLMs . |
Vulnerabilities of Large Language Models to Adversarial Attacks (2024.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial focuses on the vulnerabilities of Large Language Models to adversarial attacks . the tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity . |
| Approach: | This tutorial lays the foundation by explaining safety-aligned LLMs and concepts in cybersecurity. |
| Outcome: | The tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity. |
User Inference Attacks on Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | a large amount of data written by humans is used to train and fine-tune large language models. |
| Approach: | They propose to infer if a user's data was used to train an LLM by using example-level differential privacy. |
| Outcome: | The proposed attacks are easy to employ and only require black-box access to an LLM and a few samples from the user. |
Understanding the Effect of Model Compression on Social Bias in Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) trained with self-supervision on vast corpora of web text fit to the social biases of that text, leading to representational harm. |
| Approach: | They propose to use quantization and knowledge distillation to reduce the computational burden of LLMs to mitigate the effects of inappropriate social biases learned during pretraining. |
| Outcome: | The proposed methods reduce the computational burden of large language models by reducing their size and complexity. |
LLM Sensitivity Challenges in Abusive Language Detection: Instruction-Tuned vs. Human Feedback (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies show that instruction-tuned LLMs under-predict positive classes . however, they are overly sensitive and can be applied for abuse detection without fine-tuning . |
| Approach: | They show that instruction-tuned LLMs tend to under-predict positive classes . they also show that label frequency in the prompt helps with the significant over-prediction . |
| Outcome: | The proposed models under-predict positive classes in social media, whereas they are overly sensitive. |