Tree-of-Debate: Multi-Persona Debate Trees Elicit Critical Thinking for Scientific Comparative Analysis (2025.acl-long)
Copied to clipboard
| Challenge: | Existing comparative summarization methods focus on surface-level semantic differences, which may not capture the most relevant distinctions. |
| Approach: | They propose a framework which transforms scientific papers into LLM personas that debate their respective novelties. |
| Outcome: | The proposed framework generates informative arguments and effectively contrasts papers, and supports researchers in their literature review. |
Similar Papers
Debate, Reflect, and Distill: Multi-Agent Feedback with Tree-Structured Preference Optimization for Efficient Language Model Enhancement (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for enhancing small models struggle to yield substantial and lasting performance gains. |
| Approach: | They propose a Debate and Reflect framework that orchestrates multi-turn debates between smaller models and stronger teacher models. |
| Outcome: | The proposed framework outperforms existing methods by a large margin in smaller models. |
Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Writing arguments requires integrating high-level beliefs from various perspectives . current language models generate outputs autoregressively, resulting in limited diversity and coherence . |
| Approach: | They propose a persona-based multi-agent framework for argument writing that integrates beliefs from different perspectives into a coherent narrative. |
| Outcome: | The proposed framework generates more diverse arguments by both automatic and human evaluations. |
TreeReview: A Dynamic Tree of Questions Framework for Deep and Efficient LLM-based Scientific Peer Review (2025.emnlp-main)
Copied to clipboard
Yuan Chang, Ziyue Li, Hengyuan Zhang, Yuanbo Kong, Yanru Wu, Hayden Kwok-Hay So, Zhijiang Guo, Liya Zhu, Ngai Wong
| Challenge: | Large Language Models (LLMs) have shown significant potential in assisting peer review, but current methods struggle to generate thorough and insightful reviews while maintaining efficiency. |
| Approach: | They propose a framework that models paper review as a hierarchical and bidirectional question-answering process. |
| Outcome: | The proposed framework outperforms baselines on full review generation and actionable feedback comments generation tasks while reducing LLM token usage by up to 80% compared to computationally intensive approaches. |
ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | a new system that leverages the encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models (LLMs) is proposed to enhance the productivity of researchers . a researcher's research idea generation process involves problem identification, method development, experiment design and iterative revision . |
| Approach: | They propose a system that leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models to assist researchers in their work. |
| Outcome: | The proposed system generates novel ideas based on human and model-based evaluations . it leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models based systems . |
Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on inconsistency issues within a single LLM, while we explore the inter-consistencies among multiple LLMs for collaboration. |
| Approach: | They propose a formal debate framework to examine whether LLMs can collaborate effectively to achieve a consensus for a shared goal. |
| Outcome: | The proposed framework enables LLMs to achieve consensus in three real-world debate scenarios with real-time scenarios aligned to the LLM's goals. |
MALLM: Multi-Agent Large Language Models Framework (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Multi-agent debate (MAD) has demonstrated the ability to augment collective intelligence by scaling test-time compute and leveraging expertise. |
| Approach: | They propose an open-source framework that enables systematic analysis of multi-agent debates. |
| Outcome: | The proposed framework enables systematic analysis of multi-agent debate components. |
SciCompanion: Graph-Grounded Reasoning for Structured Evaluation of Scientific Arguments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing retrieval-augmented generation (RAG) methods fail to provide deep, relational understanding of scientific literature. |
| Approach: | They propose a graph-grounded reasoning framework for structured scientific evaluation that uses multi-hop reasoning to iteratively construct contextual graphs and generate structured critiques. |
| Outcome: | The proposed framework reduces evaluation error by over 30% compared to baselines and allows smaller models to outperform larger models. |
Evaluating the Performance of Large Language Models via Debates (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are evolving and impacting various fields . current methods for evaluation are based on fixed, domain-specific questions or rely on human input, making them unscalable. |
| Approach: | They propose a benchmarking framework based on debates between LLMs, judged by another LLM. |
| Outcome: | The proposed framework achieves rankings that align closely with popular rankings based on human input eliminating the need for costly crowdsourcing. |
DebateCoder: Towards Collective Intelligence of LLMs via Test Case Driven LLM Debate for Code Generation (2025.acl-long)
Copied to clipboard
Jizheng Chen, Kounianhua Du, Xinyi Dai, Weiming Zhang, Xihuai Wang, Yasheng Wang, Ruiming Tang, Weinan Zhang, Yong Yu
| Challenge: | Existing debate-based approaches to code generation are limited due to several reasons: 1) Reliance on different instances of the same LLM for debate, 2) under-utilization of test cases, and 3) reliance on third-party moderators for result consolidation and decision-making. |
| Approach: | They propose to use test cases to analyze code and identify bugs while opposing models generate test cases for each other to challenge each other's code during the debate process. |
| Outcome: | The proposed model collects intelligence of LLMs via test case-driven debate for code generation. |
Multiple LLM Agents Debate for Equitable Cultural Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Recent efforts focus on single-LLM, single-turn generation approaches, but it can be challenging for any single model to support all cultures equally well. |
| Approach: | They propose to exploit the complementary strengths of multiple LLMs to promote cultural adaptability. |
| Outcome: | The proposed model improves accuracy and cultural group parity over single-LLM models. |