Do Androids Question Electric Sheep? A Multi-Agent Cognitive Simulation of Philosophical Reflection on Hybrid Table Reasoning (2025.acl-srw)
Copied to clipboard
| Challenge: | Existing studies have observed that LLMs are wise enough to be thinkers of philosophical reflection. |
| Approach: | They conduct an exploratory simulation to investigate whether LLMs are wise enough to be thinkers of philosophical reflection. |
| Outcome: | The proposed frameworks underperform simpler end-to-end approaches, but they tend to overthink . the results shed light on a fundamental challenge shared by both human and machine intelligence . |
Similar Papers
Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key? (2024.acl-long)
Copied to clipboard
| Challenge: | Recent progress in LLMs discussion suggests that multi-agent discussion improves the reasoning abilities of LLM. |
| Approach: | They propose a group discussion framework to enrich the set of discussion mechanisms. |
| Outcome: | The proposed framework performs better on a wide range of reasoning tasks and backbone LLMs. |
ARGSBASE: A Multi-Agent Interface for Structured Human–AI Deliberation (2026.eacl-demo)
Copied to clipboard
| Challenge: | a new deliberation interface enables users to engage with multiple large language models (LLMs) ArgsBase exemplifies hybrid argumentation and supports epistemically responsible human–AI collaboration. |
| Approach: | They propose a deliberation interface that enables users to engage with multiple large language models coordinated by a moderator agent. |
| Outcome: | The proposed system exemplifies hybrid argumentation and aligns with recent calls for "reasonable parrots" the user study shows that the tool is easy to use, perspective-enhancing, and promising for research . |
Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate (2024.emnlp-main)
Copied to clipboard
Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Shuming Shi, Zhaopeng Tu
| Challenge: | Modern large language models (LLMs) have shown remarkable performance on general language tasks but struggle on complex reasoning tasks. |
| Approach: | They propose a multi-agent debate framework that encourages divergent thinking in LLMs . they propose to break debate and use a judge to obtain a final solution . |
| Outcome: | The proposed framework encourages divergent thinking in large language models . it is able to generate novel thoughts even if initial stance is incorrect . |
LLM Agents at the Roundtable: A Multi-Perspective and Dialectical Reasoning Framework for Essay Scoring (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new framework for automated essay scoring is needed to achieve multi-perspective understanding and judgment. |
| Approach: | They propose a roundtable essay scoring framework that performs precise and human-aligned scoring under a zero-shot setting. |
| Outcome: | The proposed framework outperforms previous zero-shot AES approaches by enabling collaboration among agents with diverse evaluation perspectives. |
Multiple LLM Agents Debate for Equitable Cultural Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Recent efforts focus on single-LLM, single-turn generation approaches, but it can be challenging for any single model to support all cultures equally well. |
| Approach: | They propose to exploit the complementary strengths of multiple LLMs to promote cultural adaptability. |
| Outcome: | The proposed model improves accuracy and cultural group parity over single-LLM models. |
Judging with Many Minds: Do More Perspectives Mean Less Prejudice? On Bias Amplification and Resistance in Multi-Agent Based LLM-as-Judge (2025.findings-emnlp)
Copied to clipboard
Chiyu Ma, Enpei Zhang, Yilun Zhao, Wenjun Liu, Yaning Jia, Peijun Qing, Lin Shi, Arman Cohan, Yujun Yan, Soroush Vosoughi
| Challenge: | LLM-as-Judge frameworks provide scalable alternative to human evaluation . but the question of how intrinsic biases manifest in these settings remains unexplored . |
| Approach: | They conduct systematic analysis of four bias types in multi-agent LLM-as-Judge frameworks . they find debate framework amplifies biases sharply after initial debate . |
| Outcome: | The proposed frameworks amplify biases after debate and show they are stronger in meta-judge scenarios. |
Debate, Reflect, and Distill: Multi-Agent Feedback with Tree-Structured Preference Optimization for Efficient Language Model Enhancement (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for enhancing small models struggle to yield substantial and lasting performance gains. |
| Approach: | They propose a Debate and Reflect framework that orchestrates multi-turn debates between smaller models and stronger teacher models. |
| Outcome: | The proposed framework outperforms existing methods by a large margin in smaller models. |
ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) still struggle with natural language reasoning tasks. |
| Approach: | They propose a multi-model multi-agent framework that enhances collaborative reasoning between LLM agents via multiple rounds of discussion. |
| Outcome: | Experiments on seven benchmarks show that ReConcile significantly improves LLM reasoning on individual and team levels. |
Systematic Biases in LLM Simulations of Debates (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current research suggests that LLM-based agents become increasingly human-like in their performance, sparking interest in using these AI agents as substitutes for human participants in behavioral studies. |
| Approach: | They propose to use LLMs to simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
| Outcome: | The proposed model can simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
Mirror: Multiple-perspective Self-Reflection Method for Knowledge-rich Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) struggle with knowledge-rich problems without external resources. |
| Approach: | They propose a Multiple-perspective self-reflection method that allows LLMs to reflect from multiple-perceptive clues, achieved through a heuristic interaction between a Navigator and a Reasoner. |
| Outcome: | The proposed method is superior to other self-reflection methods on five reasoning datasets. |