Lying with Truths: Open-Channel Multi-Agent Collusion for Belief Manipulation via Generative Montage

Challenge:	Large language models (LLMs) evolve to autonomous agents synthesizing real-time information, but their reasoning capabilities introduce an unexpected attack surface.
Approach:	They propose a framework that constructs deceptive narratives through adversarial debate and coordinated posting of evidence fragments, causing victims to internalize and propagate fabricated conclusions.
Outcome:	The proposed framework constructs deceptive narratives through adversarial debate and coordinated posting of evidence fragments, causing victims to internalize and propagate fabricated conclusions.

Similar Papers

Overview

Challenge

Approach

Outcome

Large Language Models Are Involuntary Truth-Tellers: Exploiting Fallacy Failure for Jailbreak Attacks (2024.emnlp-main)

Copied to clipboard

Yue Zhou, Henry Zou, Barbara Di Eugenio, Yang Zhang

Responsible & Trustworthy NLP

Challenge:	Existing research has shown that large language models have difficulty discerning the veracity of their intrinsic answers.
Approach:	They propose a jailbreak attack method that generates an aligned language model for malicious output.
Outcome:	The proposed method achieves competitive performance with more harmful outputs.

To Lie or Not to Lie? Investigating The Biased Spread of Global Lies by LLMs (2026.acl-long)

Copied to clipboard

Zohaib Khan, Mustafa Dogan, Ifeoma Okoh, Pouya Sadeghi, Siddhartha Shrestha, Sergius Justus Chesami Nyah, Mahmoud O. Mokhiamar, Michael J Ryan, Tarek Naous

Responsible & Trustworthy NLP

Challenge:	Misinformation is on the rise, and the strong writing capabilities of LLMs lower the barrier for malicious actors to produce and disseminate false information.
Approach:	They introduce a multilingual parallel dataset of 440 misinformation generation prompt templates and 6,867 entities, spanning 8 languages and 195 countries.
Outcome:	The proposed model reduces misinformation generation across languages and countries . it also reduces the risk of misinformation being spread across countries based on the model's performance .

Hidden in Plain Sight: Evaluation of the Deception Detection Capabilities of LLMs in Multimodal Settings (2025.acl-long)

Copied to clipboard

Md Messal Monem Miah, Adrita Anika, Xi Shi, Ruihong Huang

Multimodality

Challenge:	Detecting deception in an increasingly digital world is a critical and challenging task.
Approach:	They evaluate the performance of both open-source and proprietary LLMs on three datasets . they find that fine-tuned LLM achieve state-of-the-art performance on textual deception detection .
Outcome:	The proposed models achieve state-of-the-art on textual deception detection, whereas LMMs struggle to fully leverage multimodal cues.

Boosting LLM Agents with Recursive Contemplation for Effective Deception Handling (2024.findings-acl)

Copied to clipboard

Shenzhi Wang, Chang Liu, Zilong Zheng, Siyuan Qi, Shuo Chen, Qisen Yang, Andrew Zhao, Chaofei Wang, Shiji Song, Gao Huang

Challenge:	Recent advances in large language models (LLMs) have led to significant success in using LLMs as agents.
Approach:	They propose a cognitive framework that incorporates first-order and second-order perspective transitions into LLMs to enhance their ability to identify and counteract deceptive information.
Outcome:	The proposed framework enhances LLMs’ ability to identify and counteract deceptive information without extra fine-tuning and data.

AI-LieDar : Examine the Trade-off Between Utility and Truthfulness in LLM Agents (2025.naacl-long)

Copied to clipboard

Zhe Su, Xuhui Zhou, Sanketh Rangreji, Anubha Kabra, Julia Mendelsohn, Faeze Brahman, Maarten Sap

Challenge:	LieDar is a framework to study how LLM-based agents navigate these scenarios in a multi-turn interactive setting.
Approach:	They propose a framework to study how LLM-based agents navigate these scenarios in an interactive multi-turn setting.
Outcome:	The proposed framework shows that all models are truthful less than 50% of the time, although truthfulness and goal achievement rates vary across models.

An Empirical Study of Group Conformity in Multi-Agent Systems (2025.findings-acl)

Copied to clipboard

Min Choi, Keonwoo Kim, Sungwon Chae, Sangyeop Baek

Challenge:	Recent advances in Large Language Models (LLMs) have enabled multi-agent systems that simulate real-world interactions with near-human reasoning.
Approach:	They analyze how LLM agents shape public opinion through debates on five contentious topics by simulating over 2,500 debates.
Outcome:	The proposed models show that LLM agents adopt specific stances over time and align with numerically dominant groups or more intelligent agents, exerting a greater influence.

BadScientist: Can a Research Agent Write Convincing but Unsound Papers that Fool LLM Reviewers? (2026.acl-long)

Copied to clipboard

Fengqing Jiang, Yichen Feng, Yuetai Li, Luyao Niu, Basel Alomair, Radha Poovendran

Challenge:	Existing evidence suggests that LLMs are not able to detect scientifically unsound work from malicious or poorly designed research agents.
Approach:	They develop a framework that evaluates whether fabrication-oriented paper generation agents can deceive multi-model LLM review systems.
Outcome:	The proposed framework shows that fabricated papers achieve acceptance rates up to 18% . the framework shows only marginal improvements, with detection accuracy barely exceeding random chance.

MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debate (2024.findings-emnlp)

Copied to clipboard

Alfonso Amayuelas, Xianjun Yang, Antonis Antoniades, Wenyue Hua, Liangming Pan, William Yang Wang

Language Models

Challenge:	Large Language Models (LLMs) have shown exceptional results when working individually, and have reduced parameter size and inference times.
Approach:	They evaluate the behavior of a network of models collaborating through debate under the influence of an adversary and examine inference-time methods to generate more compelling arguments.
Outcome:	The proposed model-based model-driven analysis shows that the model-led model-mediated debates generate more compelling arguments and provide a defensive strategy.

MALLM-GAN: Multi-Agent Large Language Model as Generative Adversarial Network for Synthesizing Tabular Data (2026.findings-acl)

Copied to clipboard

Yaobin Ling, Xiaoqian Jiang, Yejin Kim

Responsible & Trustworthy NLP

Challenge:	Existing models for tabular data generation require large amounts of data to train effectively.
Approach:	They propose a framework to generate tabular data powered by large language models that emulates a Generative Adversarial Network.
Outcome:	The proposed framework outperforms state-of-the-art models while keeping privacy of real data.

Quantized but Deceptive? A Multi-Dimensional Truthfulness Evaluation of Quantized LLMs (2025.emnlp-main)

Copied to clipboard

Yao Fu, Xianxuan Long, Runchao Li, Haotian Yu, Mu Sheng, Xiaotian Han, Yu Yin, Pan Li

Semantic Text Processing

Challenge:	Quantization enables efficient deployment of large language models in resource-constrained environments . but impact on truthfulness remains largely unexplored .
Approach:	They propose a framework to assess the truthfulness of quantized large language models . they find quantized models retain internally truthful representations but produce false outputs .
Outcome:	The framework assesses the truthfulness of quantized models across three dimensions . it finds that quantized model models retain internally truthful representations but are more susceptible to false outputs .