Challenge: Names can be used as markers of individuality, cultural heritage, and personal history when interacting with chatbots.
Approach: They propose to use names as cultural bias in chatbots to adapt to user input and task contexts.
Outcome: The proposed method demonstrates that LLMs make cultural identity assumptions based on their users’ presumed backgrounds based upon their names .

Similar Papers

Reading Between the Prompts: How Stereotypes Shape LLM’s Implicit Personalization (2025.emnlp-main)

Copied to clipboard

Challenge: Prior work has shown that such inferences can lead to lower quality responses for users assumed to be from minority groups.
Approach: They analyze LLMs' latent user representations through both model internals and generated answers to targeted user questions.
Outcome: The proposed models infer demographic attributes based on stereotypical signals, which persists even when the user explicitly identifies with a different demographic group.
Stereotype or Personalization? User Identity Biases Chatbot Recommendations (2025.findings-acl)

Copied to clipboard

Challenge: We show that when people use large language models to generate recommendations, the LLMs produce responses that reflect both what the user wants and who the user is.
Approach: They propose that chatbots should transparently indicate when user’s revealed identity influences model recommendations but fail to do so .
Outcome: The proposed model generates racially stereotypical recommendations regardless of whether the user revealed their identity intentionally or unintentionally through implicit cues.
One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization (2026.acl-long)

Copied to clipboard

Challenge: Prior work has used personas to study biases by relying on a single cue to prompt a persona, such as user names or explicit attribute mentions.
Approach: They compare six commonly used personacues across seven open and proprietary LLMs on four writing and advice tasks.
Outcome: The proposed model is based on a persona, a synthetic user profile defined by specific attributes, defined by gender or race.
Can LLMs Express Personality Across Cultures? Introducing CulturalPersonas for Evaluating Trait Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have explored personality evaluation of LLMs, but they largely overlook the interplay between culture and personality.
Approach: They propose a large-scale benchmark for evaluating LLMs’ personality expression in culturally grounded, behaviorally rich contexts.
Outcome: The proposed benchmark improves alignment with country-specific human personality distributions and elicits more expressive, culturally coherent outputs compared to existing benchmarks.
Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personas (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog.
Approach: They propose to prompt LLMs with human-like personas and ask them to answer as if they were a specific human, either explicitly, with exact demographics, political beliefs, and lived experiences, or implicitly via names prevalent in specific populations.
Outcome: The proposed model is based on explicit, explicit, and implicit personas, and fails to show implicit biases.
Ask LLMs Directly, “What shapes your bias?”: Measuring Social Bias in Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to evaluate social bias in large language models have limitations . et al., 1995: stereotypes shape social perceptions without objective basis .
Approach: They propose a method to intuitively quantify social perceptions and suggest metrics to evaluate biases within LLMs.
Outcome: The proposed metrics capture the multi-dimensional aspects of social bias, the paper shows . they show that the proposed metrics can be used to evaluate bias in large language models .
Simulating Identity, Propagating Bias: Abstraction and Stereotypes in LLM-Generated Text (2025.findings-emnlp)

Copied to clipboard

Challenge: Persona-prompting is a growing strategy to personalize outputs, but its impact on how LLMs represent social groups remains underexplored.
Approach: They investigate whether persona-prompting leads to different levels of linguistic abstraction . they compare 11 persona driven responses to those of a generic AI assistant .
Outcome: The proposed method can be used to personalize outputs, but its impact on how LLMs represent social groups remains underexplored.
Towards Measuring and Modeling “Culture” in LLMs: A Survey (2024.emnlp-main)

Copied to clipboard

Challenge: Existing models are biased towards Western, Anglocentric or American cultures, a problem that is arguably detrimental to the performance of LLMs.
Approach: They analyze more than 90 recent papers that aim to study cultural representation and inclusion in large language models.
Outcome: The proposed models are biased towards Western, Anglocentric or American cultures, despite their diversity and their robustness.
Through the Looking Glass of Multilingual AI: Contrasting Language- and Name Script-Dependent Ethnic Hierarchies in GPT and DeepSeek (2026.acl-srw)

Copied to clipboard

Challenge: a recent study found that large language models are biased overwhelmingly Anglocentric . a stereotype perceptual map is a framework for analyzing how ethnic groups are positioned along evaluative dimensions.
Approach: They use a stereotype perceptual map to examine how ethnic groups are positioned along evaluative dimensions.
Outcome: The stereotype perceptual map analyzes model behavior across languages, scripts, evaluative domains and models.
Exploring Inherent Biases in LLMs within Korean Social Context: A Comparative Analysis of ChatGPT and GPT-4 (2024.naacl-srw)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been criticized for perpetuating stereotypes against diverse groups based on race, sexual orientation, and other attributes.
Approach: They devised a set of prompts that reflect major societal issues in Korea and assign varied personas to both ChatGPT and GPT-4 to assess the toxicity of the generated sentences.
Outcome: The proposed model produces twice the level of toxic content as ChatGPT and GPT-4 under certain conditions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations