Challenge: Current studies evaluate LLMs on explicit false statements, overlooking how misinformation manifests subtly as unchallenged premises in real-world interactions.
Approach: They propose to use EchoMist to analyze implicit misinformation from diverse sources . they also investigate two mitigation methods to enhance LLMs’ capability to counter implicit mis information.
Outcome: The proposed model fails to detect false premises and generate counterfactual explanations.

Similar Papers

Evaluation of LLM Vulnerabilities to Being Misused for Personalized Disinformation Generation (2025.acl-long)

Copied to clipboard

Challenge: Recent large language models generate disinformation news articles following predefined narratives . personalization and disinformation abilities of LLMs have not been studied .
Approach: They evaluate the personalization and disinformation abilities of large language models . they find personalization reduces the safety-filter activations, thus effectively functioning as a jailbreak .
Outcome: The proposed model generates disinformation news articles in english with the lowest quality of personalization.
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for detection of misinformation generated by large language models fail to mitigate societal risks . authors propose a paradigm shift from passive detection to anticipatory mitigation strategies . existing defenses remain reactionary in an era demanding proactive defense, authors say .
Approach: They propose a three-pillar approach to prevent misinformation by fortifying integrity of training data and inference reliability by embedding self-corrective mechanisms during reasoning.
Outcome: The proposed framework improves existing methods in misinformation prevention by 63% . it demonstrates that existing methods exhibit false negative rates against misinformation .
Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions (2024.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that large language models are susceptible to societal biases due to their exposure to human-generated data.
Approach: They propose two strategies to mitigate implicit gender biases in large language models . they create scenarios where implicit gender is present and develop a metric to assess the presence of biase .
Outcome: The proposed methods mitigate implicit biases with self-reflection and fine-tuning.
Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Large language models (LLMs) have significant impact on various industries and societal functions due to advanced instruction-following capabilities.
Approach: They developed and tested novel attack strategies on popular LLMs to expose their vulnerabilities in generating harmful content.
Outcome: The proposed attacks achieved an ASR of 100% on open-source models, including Meta’s Llama-3.2, Google’s Gemma-2, Mistral’s Mistral-NeMo, Falcon’s Falcon-mamba, Apple’s DCLM, Microsoft’s Phi3, and Qwen’s Qwend2.5, among others.
MisinfoBench: A Multi-Dimensional Benchmark for Evaluating LLMs’ Resilience to Misinformation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks assess factual accuracy in isolated queries but fail to evaluate LLMs’ resilience to misinformation in interactive settings.
Approach: MisinfoBench is a benchmark designed to assess LLMs’ ability to discern, resist, and reject misinformation.
Outcome: MisinfoBench assesses large language models’ ability to discern, resist, and reject misinformation in interactive settings.
How does Misinformation Affect Large Language Model Behaviors and Preferences? (2025.acl-long)

Copied to clipboard

Challenge: Existing studies have explored the role of Large Language Models in combating misinformation, but there is still a lack of detailed analysis on the specific aspects and extent to which LLMs are influenced by misinformation.
Approach: They propose to use a benchmark to evaluate LLMs' behavior and knowledge preference toward misinformation to identify their models.
Outcome: The proposed approach is based on 10,346,712 pieces of misinformation and examines knowledge conflicts and stylistic variations.
On the Risk of Misinformation Pollution with Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: a recent study demonstrates that large language models can be misused for generating credible-sounding misinformation . however, the ability to produce credible text raises concerns regarding their potential misuse .
Approach: They propose three defense strategies to mitigate misinformation generated by Large Language Models . they propose a threat model and simulate potential misuse scenarios .
Outcome: The proposed defense strategies have shown promising results, albeit with costs.
Resilience of Large Language Models for Noisy Instructions (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) are powerful tools for interpreting human commands and generating text.
Approach: They examine the resilience of large language models against five common types of disruptions including ASR, OCR, grammatical errors, typographical errors and distractive content.
Outcome: The models show resistance to noise, but their performance suffers . authors evaluated the models against five common types of disruptions based on their results .
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: a growing number of researchers are studying the hallucination issue in large language models.
Approach: They propose a hallucination detection benchmark and a method to detect hallucines in LLMs.
Outcome: The proposed method detects hallucinations and mitigates them using different training stages.
Vulnerabilities of Large Language Models to Adversarial Attacks (2024.acl-tutorials)

Copied to clipboard

Challenge: This tutorial focuses on the vulnerabilities of Large Language Models to adversarial attacks . the tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity .
Approach: This tutorial lays the foundation by explaining safety-aligned LLMs and concepts in cybersecurity.
Outcome: The tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations