The AI Gap: How Socioeconomic Status Affects Language Technology Interactions (2025.acl-long)
Copied to clipboard
| Challenge: | Socioeconomic status (SES) fundamentally influences how people interact with technology, but it is limited by proxy metrics and synthetic data. |
| Approach: | They collect 6,482 prompts from previous interactions of 1,000 individuals from ‘diverse socioeconomic backgrounds’ about their use of language technologies and generative AI. |
| Outcome: | The findings show that higher SES groups have higher levels of abstraction, convey requests more concisely, and topics like ‘inclusivity’ and ‘travel’. |
Similar Papers
Classist Tools: Social Class Correlates with Performance in NLP (2024.acl-long)
Copied to clipboard
| Challenge: | despite growing concerns surrounding fairness and bias in NLP, there is a dearth of studies delving into the effects it may have on NLP systems. |
| Approach: | They argue that NLP systems’ performance is affected by speakers’ SES, potentially disadvantaging less-privileged socioeconomic groups. |
| Outcome: | The proposed model shows that NLP systems perform better on tasks with social class, ethnicity and geographical variation than those without social class. |
Quantifying the Dialect Gap and its Correlates Across Languages (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Historically, studies investigating minority variants of languages have been limited to a select few languages. |
| Approach: | They evaluate state-of-the-art large language models for regional dialects of several high- and low-resource languages and analyze how regional dialect gap is correlated with economic, social, and linguistic factors. |
| Outcome: | The proposed model is compared with two high-use applications and shows that it can solve the regional dialect gap. |
Bridging the Digital Divide: Performance Variation across Socio-Economic Factors in Vision-Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Among the minority groups under-represented in AI, data from low-income households are often overlooked in data collection and model evaluation. |
| Approach: | They evaluate the performance of a vision-language model on a geo-diverse dataset . they highlight insights that can help mitigate these issues and propose actionable steps for economic-level inclusive AI development. |
| Outcome: | The proposed model performs lower for the poorer groups than the wealthier groups across topics and countries. |
The Linguistic Connectivities Within Large Language Models (2025.findings-acl)
Copied to clipboard
Dan Wang, Boxi Cao, Ning Bian, Xuanang Chen, Yaojie Lu, Hongyu Lin, Jia Zheng, Le Sun, Shanshan Jiang, Bin Dong, Xianpei Han
| Challenge: | Recent studies have discovered notable disparities in their performance across different languages. |
| Approach: | They conduct a systematic investigation into the behaviors of large language models across 27 different languages on 3 different scenarios and reveals a Linguistic Map correlates with the richness of available resources and linguistic family relations. |
| Outcome: | The proposed model demonstrates that there are significant disparities in performance across languages across 27 different languages on 3 different scenarios. |
Human Alignment: How Much Do We Adapt to LLMs? (2025.acl-short)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are becoming a common part of our lives, yet few studies have examined how they influence our behavior. |
| Approach: | They propose a cooperative language game in which players aim to converge on a word and play a game in a group. |
| Outcome: | The proposed game shows that humans notice and adapt to differences regardless of whether they are aware they are interacting with an LLM. |
Human-AI Interaction in the Age of LLMs (2024.naacl-tutorials)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have revolutionized the capabilities of AI systems. |
| Approach: | This tutorial will provide an overview of the interaction between humans and Large Language Models (LLMs) it will start with a review of the types of AI models we interact with and walkthrough of the core concepts in Human-AI Interaction. |
| Outcome: | This tutorial will provide an overview of the interaction between humans and LLMs, exploring the challenges, opportunities, and ethical considerations that arise in this dynamic landscape. |
‘Rich Dad, Poor Lad’: How do Large Language Models Contextualize Socioeconomic Factors in College Admission ? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models are increasingly involved in high-stakes domains, yet how they reason about socially sensitive decisions remains underexplored. |
| Approach: | They propose a dual-process audit framework to probe LLMs’ reasoning behaviors in sensitive applications using a synthetic dataset of 30,000 applicant profiles grounded in real-world correlations. |
| Outcome: | The proposed framework exploits a synthetic dataset of 30,000 applicant profiles grounded in real-world correlations to probe LLMs' reasoning behaviors in sensitive applications. |
Impoverished Language Technology: The Lack of (Social) Class in NLP (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work on socio-demographic factors has focused on how much a person's socioeconomic status affects their language production and perception. |
| Approach: | They propose to include socio-economic class in future natural language processing (NLP) research aimed at understanding relationships between socio-demographic factors and language production and perception. |
| Outcome: | The proposed definition of class can be operationalised by NLP researchers and argue for including socio-economic class in future language technologies. |
The Impact of Large Language Models in Academia: from Writing to Speaking (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impacting human society, especially in textual information. |
| Approach: | They propose to build an automated monitoring platform to track the impact of large language models on human expression. |
| Outcome: | The results show that LLM-style words such as significant are used more frequently in abstracts and oral presentations. |
Language Technologies as If People Mattered: Centering Communities in Language Technology Development (2024.lrec-main)
Copied to clipboard
| Challenge: | Developing and deploying language technologies "as if people mattered" requires a reflexive and receptive approach, argues a new position paper . |
| Approach: | They argue that researchers should address linguistic and algorithmic injustice together with language communities to build strong interdisciplinary teams. |
| Outcome: | The authors argue that researchers should address social and linguistic injustice together with language communities to solve the challenges raised by language technologies. |