Challenge: Current methods struggle to distinguish targets in low Signal-to-Noise Ratio environments and lack sufficient pre-execution verification to prevent error accumulation.
Approach: They propose a Memory-augmented Debate System to ensure precise grounding across diverse interfaces and handle irreversible errors in extended workflows.
Outcome: The proposed system achieves a 90.23% task success rate on MaDS-Benchmark and strong performance on public benchmarks including AITW, AITZ, CAGUI, and GUIOdyssey.

Similar Papers

Free-MAD: Consensus-Free Multi-Agent Debate (2026.findings-acl)

Copied to clipboard

Challenge: Existing multi-agent debate methods rely on multiple rounds of interaction among agents to reach consensus, and the final output is decided by majority voting in the last round.
Approach: They propose a multi-agent debate framework that eliminates the need for consensus among agents and reconstructs the debate phase by introducing anti-conformity.
Outcome: Experiments on eight benchmark datasets show that Free-MAD significantly improves reasoning performance while requiring only a single-round debate and thus reducing token costs.
S2-MAD: Breaking the Token Barrier to Enhance Multi-Agent Debate Efficiency (2025.naacl-long)

Copied to clipboard

Challenge: Large language models exhibit limitations when handling complex mathematical reasoning and logical inference tasks.
Approach: They propose a sparsification strategy to reduce token costs within Multi-agent Debate (MAD) this strategy minimizes ineffective exchanges of information and unproductive discussions among agents .
Outcome: The proposed approach reduces token costs by up to 94.5% while maintaining performance degradation below 2.0%.
MALLM: Multi-Agent Large Language Models Framework (2025.emnlp-demos)

Copied to clipboard

Challenge: Multi-agent debate (MAD) has demonstrated the ability to augment collective intelligence by scaling test-time compute and leveraging expertise.
Approach: They propose an open-source framework that enables systematic analysis of multi-agent debates.
Outcome: The proposed framework enables systematic analysis of multi-agent debate components.
M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown their potential to deliver human-like judgments.
Approach: They propose a systematic LLM-based multi-agent framework for advanced LLM as-a-judge MT evaluation that integrates dimension-specific results into a final evaluation judgment.
Outcome: The proposed framework outperforms existing LLM-as-a-judge methods and competes with state-of-the-art automatic metrics even when powered by a suboptimal model like GPT-4o mini.
Enhancing Multi-Agent Debate System Performance via Confidence Expression (2025.findings-emnlp)

Copied to clipboard

Challenge: Multi-Agent Debate systems leverage multiple LLMs to improve task performance.
Approach: They propose to integrate confidence expression into MAD systems to help LLMs communicate their confidence levels.
Outcome: The proposed approach improves debate effectiveness and overall system performance by integrating confidence expression into MAD systems.
MADRA: Multi-Agent Debate for Risk-Aware Embodied Planning (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety alignment methods, such as RLHF, fall into a Safety-Utility Trade-off, resulting in severe over-rejection of benign household instructions.
Approach: They propose a meta-cognitive Critical Agent that evaluates peer debates using a structured argumentation framework derived from the Toulmin Model.
Outcome: The proposed architecture outperforms existing systems in the SafeAware-VH benchmark.
MADial-Bench: Towards Real-world Evaluation of Memory-Augmented Dialogue Generation (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluation metrics for memory-augmented dialogue systems lack practical value . current evaluation methods only consider passive memory retrieval while ignoring diverse memory recall with rich triggering factors.
Approach: They propose to use long-term memory to create human-like dialogues using chatbots.
Outcome: The proposed benchmark covers memory retrieval and memory recognition tasks with both passive and proactive memory recall data.
Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate multi-session memory in text-only conversations or assess multimodal understanding within localized contexts.
Approach: They propose a benchmark for evaluating multimodal long-term conversational memory in MLLM agents.
Outcome: The proposed framework assesses key memory capabilities along three functional dimensions: memory extraction and test-time adaptation, memory reasoning, and memory knowledge management.
UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization (2026.acl-long)

Copied to clipboard

Challenge: Experimental results show that UI-Copilot-7B achieves state-of-the-art performance on challenging MemGUI-Bench, outperforming strong 7B-scale GUI agents such as GUI-Owl-7B and UITARS-1.5-7B.
Approach: They propose a collaborative framework where the GUI agent focuses on task execution while a lightweight copilot provides on-demand assistance for memory retrieval and numerical computation.
Outcome: The proposed framework outperforms GUI-Owl-7B and UI-TARS-1.5-7B on MemGUI-Bench and delivers 17.1% improvement on AndroidWorld over the base Qwen model.
SELENE: Selective and Evidence-Weighted LLM Debating for Efficient and Reliable Reasoning (2026.eacl-industry)

Copied to clipboard

Challenge: Existing multi-agent debate frameworks are computationally expensive and prone to degradation under pro-longed debates due to redundant exchanges and unstable judging.
Approach: They propose a framework that unifies Selective Debate Initiation (SDI) with Evidence Weighted Self-Consistency (EWSC) for adaptive, debate-on-demand reasoning.
Outcome: Evaluated on BoolQ, CosmosQA, and an internal QnA benchmark, the proposed framework achieves higher factual robustness and efficiency.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations