Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Multi-agent systems (MAS) are increasingly used for open-ended idea generation . when and why collective interaction expands the solution space remains unclear . |
| Approach: | They propose to study diversity in multi-agent systems across three bottom-up levels: model intelligence, agent cognition, and system dynamics. |
| Outcome: | The proposed model yields diminishing diversity despite higher quality . the proposed model fails to expand diversity and causes it to collapse . |
Similar Papers
Creativity in LLM-based Multi-Agent Systems: A Survey (2025.emnlp-main)
Copied to clipboard
Yi-Cheng Lin, Kang-Chieh Chen, Zhe-Yan Li, Tzu-Heng Wu, Tzu-Hsuan Wu, Kuan-Yu Chen, Hung-yi Lee, Yun-Nung Chen
| Challenge: | Large language model (LLM)-driven multi-agent systems (MAS) are transforming how humans and AIs collaboratively generate ideas and artifacts. |
| Approach: | They present a taxonomy of agent proactivity and persona design and an overview of generation techniques. |
| Outcome: | The proposed framework and roadmap offers a roadmap for advancing the development, evaluation, and standardization of creative MAS. |
The Hidden Strength of Disagreement: Unraveling the Consensus-Diversity Tradeoff in Adaptive Multi-Agent Systems (2025.emnlp-main)
Copied to clipboard
| Challenge: | Conventional LLM-based MAS rely on explicit coordination, e.g., prompts or voting, risking premature homogenization. |
| Approach: | They propose to preserve partial diversity by combining in-context learning with explicit coordination to form consensus in dynamic environments. |
| Outcome: | The proposed model outperforms explicit consensus models on three scenarios showing that partial deviation from group norms boosts exploration, robustness, and performance. |
Hetero-Designer: Automated Design of Multi-Agent Systems with Heterogeneous LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to design LLM-based Multi-agent systems are constrained by homogeneous LLMs. |
| Approach: | They propose an automated design of heterogeneous-LLMs-based MAS with a binary-star transformer and an autoregressive graph generation pipeline. |
| Outcome: | The proposed pipeline is high-performing on various benchmarks and extensible to unseen LLMs and roles. |
Single-Agent Generation Surpasses Multi-Agent Systems in Semantic Diversity (2026.findings-acl)
Copied to clipboard
| Challenge: | Multi-Agent Systems (MAS) are used to improve reasoning diversity and robustness by simulating interactions among agents with distinct roles. |
| Approach: | They find that a Multi-Output strategy produces the highest diversity without degrading logical validity. |
| Outcome: | The proposed approach outperforms multi-agent systems in semantic diversity . the results point to a more efficient and effective way to expand diversity - the authors say . |
An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Making (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have sparked interest in collaborative LLM agents. |
| Approach: | They propose to integrate various ordinal preferential voting mechanisms into LLMs to improve reasoning capabilities and robustness. |
| Outcome: | The proposed method improves reasoning capabilities and robustness of leading LLMs without complex system designs. |
Superficial Success vs. Internal Breakdown: An Empirical Study of Generalization in Adaptive Multi-Agent Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Adaptive multi-agent systems (MAS) are increasingly adopted as solutions to complex problems. |
| Approach: | They conduct extensive empirical study on adaptive multi-agent systems . they find they are prone to topological overfitting and exhibit illusory coordination . authors urge prioritization of generalization in MAS development and evaluation . |
| Outcome: | a new study shows adaptive multi-agent systems are prone to overfitting and lack coordination . the findings highlight the need to prioritize generalization in MAS development . |
The Subtle Art of Defection: Understanding Uncooperative Behaviors in LLM based Multi-Agent Systems (2026.eacl-industry)
Copied to clipboard
| Challenge: | Existing literature on uncooperative behavior degrades collective outcomes and requires more resilient multi-agent systems. |
| Approach: | They propose a game theory-based taxonomy of uncooperative agent behaviors and a structured, multi-stage simulation pipeline that dynamically generates and refines uncooperation behaviors as agents’ states evolve. |
| Outcome: | The proposed framework achieves 96.7% accuracy in generating realistic uncooperative behaviors, validated by human evaluations. |
Identifying Collective Intelligence Factor in LLM Agent Groups for Generalizable Multi-Agent System Design (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior studies have focused on designing customized MAS for specific tasks . a critical research question remains: do LLM agent groups exhibit a form of "general intelligence" |
| Approach: | They find a Collective Intelligence factor in human groups that captures their general capability. |
| Outcome: | The proposed model predicts the ACI factor based on the features of LLM agent groups and can improve generalization abilities. |
The Price of Format: Diversity Collapse in LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Instruction-tuned large language models employ structured templates to enforce format consistency during inference. |
| Approach: | They fine-tune instruction-tuning large language models with structured templates and evaluate their results across three axes: downstream task performance, alignment behavior, and output diversity. |
| Outcome: | The proposed model generates semantically similar outputs even under high temperature sampling and structural tokens in templates significantly constrain the model’s output space. |
Social Dynamics as Critical Vulnerabilities that Undermine Objective Decision-Making in LLM Collectives (2026.acl-long)
Copied to clipboard
| Challenge: | Large language model (LLM) agents are increasingly acting as human delegates in multi-agent environments, where a representative agent integrates diverse peer perspectives to make a final decision. |
| Approach: | They define four key phenomena—social conformity, perceived expertise, dominant speaker effect, and rhetorical persuasion—and manipulate the number of adversaries, relative intelligence, argument length, and argumentative styles. |
| Outcome: | The results show that the reliability of the representative agent is undermined by the social context of its network. |