Large Language Models Are Echo Chambers (2024.lrec-main)

Copied to clipboard

Challenge: Modern large language models and chatbots are subject to criticism in many aspects.
Approach: They show that large language models and chatbots are echo chambers . they annotate inputs and show that all chatbot agree .
Outcome: The proposed models show that they tend to agree with the opinions of their users.

Similar Papers

Decoding Echo Chambers: LLM-Powered Simulations Revealing Polarization in Social Networks (2025.coling-main)

Copied to clipboard

Challenge: Existing studies on social media echo chambers have been limited to numbers and formulas.
Approach: They propose an LLM-based simulation for the social opinion network to evaluate and counter polarization phenomena.
Outcome: The proposed model can simulate opinion dynamics and echo chambers using language-based simulations.
What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection (2024.acl-long)

Copied to clipboard

Challenge: Social media bot detection has always been an arms race between advancements in machine learning and adversarial bot strategies to evade detection.
Approach: They propose a mixture-of-heterogeneous-experts framework to divide and conquer diverse user information modalities and propose LLM-guided manipulation of user textual and structured information to evade detection.
Outcome: The proposed framework outperforms state-of-the-art baselines on 1,000 annotated examples while bringing down existing detectors by 29.6% and harming calibration and reliability of bot detection systems.
Do Language Models Have Semantics? On the Five Standard Positions (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are trained to solve the so-called cloze task . solving clozing tasks is essentially a memorization task, says a recent study .
Approach: They propose to use five positions to determine whether large language models exhibit semantic understanding . large language model is trained to solve the so-called cloze task .
Outcome: The proposed theory is based on a pairwise comparison of five positions on semantic understanding in large language models and chatbots.
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have gained significant attention due to their capabilities in performing diverse tasks across domains.
Approach: They review the primary challenges and limitations causing inconsistencies in evaluations . early models could generate coherent text but limited to simple tasks .
Outcome: The proposed evaluations are reproducible, reliable, and robust.
Bias in the Mirror : Are LLMs opinions robust to their own adversarial attacks (2025.acl-long)

Copied to clipboard

Challenge: Existing work on large language models lacks robustness, highlighting the limitations of such models.
Approach: They propose a novel approach where two LLMs engage in self-debate to persuade a neutral version of the model.
Outcome: The proposed approach examines whether large language models are robust during interactions and whether they are susceptible to reinforcing misinformation or shifting to harmful viewpoints.
Factuality of Large Language Models: A Survey (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are factually incorrect, which limits their applicability in real-world scenarios.
Approach: They analyze existing work to identify major challenges and their associated causes . they propose to evaluate LLMs using a variety of measures to mitigate factual errors .
Outcome: The proposed methods are based on a variety of datasets and proposed strategies to mitigate factual errors.
Evaluating Large Language Model Biases in Persona-Steered Generation (2024.findings-acl)

Copied to clipboard

Challenge: a recent wave of powerful new large language models has raised concerns that their expressed opinions may be biased towards certain political, national or moral viewpoints.
Approach: They define an incongruous persona as a persona with multiple traits where one trait makes its other traits less likely in human survey data.
Outcome: The results show that LLMs are less steerable towards incongruous personas than congruous ones . the models that are fine-tuned with RLHF are more steerable, especially towards stances associated with political liberals and women .
The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in Large Language Models have sparked interest in validating human-like cognitive-behavioral traits.
Approach: They examine whether LLM outputs reflect human-like cognitive-behavioral traits . they find that measuring AOVs embedded within LLMs remains opaque .
Outcome: The proposed model can be used to evaluate human-like cognitive-behavioral traits . the proposed model could be used in writing assistants and other applications .
Think Again! The Effect of Test-Time Compute on Preferences, Opinions, and Beliefs of Large Language Models (2025.acl-industry)

Copied to clipboard

Challenge: Large Language Models exhibit subjective preferences, opinions, and beliefs, which may shape their behavior, influence advice and recommendations, and potentially reinforce certain viewpoints.
Approach: They developed a benchmark to assess LLMs’ subjective inclinations across societal, cultural, ethical, and personal domains.
Outcome: The proposed benchmark assesses LLMs’ subjective inclinations across societal, cultural, ethical, and personal domains.
Finding A Voice: Exploring the Potential of African American Dialect and Voice Generation for Chatbots (2025.acl-long)

Copied to clipboard

Challenge: This study examines how linguistic similarity affects chatbot performance, focusing on integrating African American English (AAE) into virtual agents to better serve the African American community.
Approach: They develop text-based and spoken chatbots using large language models and text-to-speech technology and evaluate them with AAE speakers to better serve the African American community.
Outcome: The proposed language-based chatbots with African American English speakers outperform standard English chatbot models and show that spoken chatbot features improve performance and preference.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations