How to Protect Yourself from 5G Radiation? Investigating LLM Responses to Implicit Misinformation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current studies evaluate LLMs on explicit false statements, overlooking how misinformation manifests subtly as unchallenged premises in real-world interactions. |
| Approach: | They propose to use EchoMist to analyze implicit misinformation from diverse sources . they also investigate two mitigation methods to enhance LLMs’ capability to counter implicit mis information. |
| Outcome: | The proposed model fails to detect false premises and generate counterfactual explanations. |
Similar Papers
Evaluation of LLM Vulnerabilities to Being Misused for Personalized Disinformation Generation (2025.acl-long)
Copied to clipboard
Aneta Zugecova, Dominik Macko, Ivan Srba, Robert Moro, Jakub Kopál, Katarína Marcinčinová, Matúš Mesarčík
| Challenge: | Recent large language models generate disinformation news articles following predefined narratives . personalization and disinformation abilities of LLMs have not been studied . |
| Approach: | They evaluate the personalization and disinformation abilities of large language models . they find personalization reduces the safety-filter activations, thus effectively functioning as a jailbreak . |
| Outcome: | The proposed model generates disinformation news articles in english with the lowest quality of personalization. |
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models (2025.findings-acl)
Copied to clipboard
Shuliang Liu, Hongyi Liu, Aiwei Liu, Duan Bingchen, Zheng Qi, Yibo Yan, He Geng, Peijie Jiang, Jia Liu, Xuming Hu
| Challenge: | Existing methods for detection of misinformation generated by large language models fail to mitigate societal risks . authors propose a paradigm shift from passive detection to anticipatory mitigation strategies . existing defenses remain reactionary in an era demanding proactive defense, authors say . |
| Approach: | They propose a three-pillar approach to prevent misinformation by fortifying integrity of training data and inference reliability by embedding self-corrective mechanisms during reasoning. |
| Outcome: | The proposed framework improves existing methods in misinformation prevention by 63% . it demonstrates that existing methods exhibit false negative rates against misinformation . |
Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that large language models are susceptible to societal biases due to their exposure to human-generated data. |
| Approach: | They propose two strategies to mitigate implicit gender biases in large language models . they create scenarios where implicit gender is present and develop a metric to assess the presence of biase . |
| Outcome: | The proposed methods mitigate implicit biases with self-reflection and fine-tuning. |
Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have significant impact on various industries and societal functions due to advanced instruction-following capabilities. |
| Approach: | They developed and tested novel attack strategies on popular LLMs to expose their vulnerabilities in generating harmful content. |
| Outcome: | The proposed attacks achieved an ASR of 100% on open-source models, including Meta’s Llama-3.2, Google’s Gemma-2, Mistral’s Mistral-NeMo, Falcon’s Falcon-mamba, Apple’s DCLM, Microsoft’s Phi3, and Qwen’s Qwend2.5, among others. |
MisinfoBench: A Multi-Dimensional Benchmark for Evaluating LLMs’ Resilience to Misinformation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks assess factual accuracy in isolated queries but fail to evaluate LLMs’ resilience to misinformation in interactive settings. |
| Approach: | MisinfoBench is a benchmark designed to assess LLMs’ ability to discern, resist, and reject misinformation. |
| Outcome: | MisinfoBench assesses large language models’ ability to discern, resist, and reject misinformation in interactive settings. |
How does Misinformation Affect Large Language Model Behaviors and Preferences? (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies have explored the role of Large Language Models in combating misinformation, but there is still a lack of detailed analysis on the specific aspects and extent to which LLMs are influenced by misinformation. |
| Approach: | They propose to use a benchmark to evaluate LLMs' behavior and knowledge preference toward misinformation to identify their models. |
| Outcome: | The proposed approach is based on 10,346,712 pieces of misinformation and examines knowledge conflicts and stylistic variations. |
On the Risk of Misinformation Pollution with Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study demonstrates that large language models can be misused for generating credible-sounding misinformation . however, the ability to produce credible text raises concerns regarding their potential misuse . |
| Approach: | They propose three defense strategies to mitigate misinformation generated by Large Language Models . they propose a threat model and simulate potential misuse scenarios . |
| Outcome: | The proposed defense strategies have shown promising results, albeit with costs. |
Resilience of Large Language Models for Noisy Instructions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are powerful tools for interpreting human commands and generating text. |
| Approach: | They examine the resilience of large language models against five common types of disruptions including ASR, OCR, grammatical errors, typographical errors and distractive content. |
| Outcome: | The models show resistance to noise, but their performance suffers . authors evaluated the models against five common types of disruptions based on their results . |
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | a growing number of researchers are studying the hallucination issue in large language models. |
| Approach: | They propose a hallucination detection benchmark and a method to detect hallucines in LLMs. |
| Outcome: | The proposed method detects hallucinations and mitigates them using different training stages. |
Vulnerabilities of Large Language Models to Adversarial Attacks (2024.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial focuses on the vulnerabilities of Large Language Models to adversarial attacks . the tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity . |
| Approach: | This tutorial lays the foundation by explaining safety-aligned LLMs and concepts in cybersecurity. |
| Outcome: | The tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity. |