H-MAS: Hierarchical Multi-Agent Scheduling for Multi-Tenant LLM Serving

Challenge:	Multi-tenant Model-as-a-Service (MaaS) workloads exhibit non-stationarity across multiple time scales . existing request schedulers often rely on a fixed policy that remains unchanged at runtime .
Approach:	They propose a hierarchical multi-agent scheduler that operates in a layered closed loop . they propose to maintain 1.2–3.0 higher Goodput than SGLang and vLLM .
Outcome:	Experiments show that H-MAS achieves 1.2–3.0 higher Goodput than SGLang and vLLM . it maintains more stable QoS under diverse request lengths and heterogeneous SLO targets .

Similar Papers

Overview

Challenge

Approach

Outcome

LLM-as-Scheduler: Agentic Workflow Dynamic Scheduling (2026.acl-long)

Copied to clipboard

Dawei Xiang, Kexin Chu, Wenyan Xu, Wenhui Zhang, Wei Zhang

Semantic Text Processing

Challenge:	Experiments show that LAS cuts token usage by 43% and reduces end-to-end latency by more than 36%, while causing at most a 1.4 percentage-point drop in accuracy compared with a strong fixed workflow.
Approach:	They propose a system that dynamically chooses the right workflow for each query.
Outcome:	Experiments show that LAS cuts token usage by 43% and reduces end-to-end latency by more than 36% while causing at most a 1.4 percentage-point drop in accuracy compared with a strong fixed workflow.

TPS-Bench: Evaluating AI Agents’ Tool Planning & Scheduling Abilities in Compounding Tasks (2026.acl-long)

Copied to clipboard

Hanwen Xu, Xuyao Huang, Yuzhe Liu, Zhijie Deng

Green & Sustainable NLP

Challenge:	Large language model (LLM) agents have demonstrated strong problem-solving competence across domains like research and coding.
Approach:	They propose to use a tool repository to analyze the ability of large language model agents to solve complex problems.
Outcome:	The proposed model outperforms open-source and closed-source models in task completion rate and efficiency.

End-to-End Optimization of LLM-Driven Multi-Agent Search Systems via Heterogeneous-Group-Based Reinforcement Learning (2026.acl-long)

Copied to clipboard

Guanzhong Chen, Shaoxiong Yang, Chao Li, Wei Liu, Jian Luan, Zenglin Xu

Green & Sustainable NLP

Challenge:	Existing multi-agent reinforcement learning methods depend on large critic networks to evaluate joint actions, leading to instability and high memory costs.
Approach:	They propose a method to optimize large language models for agent-specific roles . they propose combining agent-based frameworks with retrieval-augmented generation .
Outcome:	Experiments show that multi-agent group policy optimization outperforms baselines in task performance and computational efficiency.

H-MEM: Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents (2026.eacl-long)

Copied to clipboard

Haoran Sun, Shaoning Zeng, Bob Zhang

Responsible & Trustworthy NLP

Challenge:	Long-term memory is one of the key factors influencing the reasoning capabilities of Large Language Model Agents.
Approach:	They propose a hierarchical memory architecture that organizes and updates memory in a multi-level fashion based on the degree of semantic abstraction.
Outcome:	The proposed model outperforms baseline methods on five task settings from the LoCoMo dataset.

MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing (2026.acl-demo)

Copied to clipboard

Yang Liu, Jinxuan Cai, Yishen Li, Qi Meng, Zedi Liu, Xin Li, Chen Qian, Chuan Shi, Cheng Yang

Structured Data in NLP

Challenge:	Large language model-based multi-agent systems (MAS) are increasingly used to extend agentic problem solving via role specialization and collaboration.
Approach:	They propose a graph-centric framework for orchestrating large language model-based multi-agent systems . they compile a user's natural-language intent into an editable workflow specification and then into an executable graph .
Outcome:	The proposed framework compiles natural-language intent into an executable graph and then compile and executes it at runtime.

TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systems (2026.acl-long)

Copied to clipboard

Ishan Kavathekar, Hemang Jain, Ameya Rathod, Ponnurangam Kumaraguru, Tanuja Ganu

Robustness in NLP

Challenge:	Existing benchmarks and datasets focus on single-agent settings, failing to capture the unique vulnerabilities of multi-agend LLM dynamics and co-ordination.
Approach:	They propose a benchmark to evaluate the robustness and safety of multi-agent LLM systems.
Outcome:	The proposed benchmark evaluates the robustness and safety of multi-agent LLM systems.

Harmonizing Dense and Sparse Signals in Multi-turn RL: Dual-Horizon Credit Assignment for Industrial Sales Agents (2026.acl-industry)

Copied to clipboard

Haojin Yang, Ai Jian, Yiwei Wang, Xinyue Huang, Weipeng Zhang, Ke Zeng, Xunliang Cai, Jingqing Ruan

Challenge:	Large language models for industrial sales require balancing long-term commercial objectives with immediate linguistic constraints such as fluency and compliance.
Approach:	They propose a framework that disentangles optimization across time scales by normalizing advantages from turn-level and session-level rewards before fusion.
Outcome:	The proposed framework outperforms the state-of-the-art GRPO model in conversion rate and identity detection rate.

MasRouter: Learning to Route LLMs for Multi-Agent Systems (2025.acl-long)

Copied to clipboard

Yanwei Yue, Guibin Zhang, Boyang Liu, Guancheng Wan, Kun Wang, Dawei Cheng, Yiyan Qi

Semantic Text Processing

Challenge:	Multi-agent systems (MAS) powered by Large Language Models (LLMs) have been demonstrated to push the boundaries of LLM capabilities, yet they often face significant costs and challenges in dynamic LLM selection.
Approach:	They propose a multi-agent system routing solution that integrates all components of MAS into a unified routing framework.
Outcome:	The proposed solution is high-performing, cost-effective, and efficient . it reduces overhead by up to 52.07 compared to current methods on HumanEval .

EPO: Hierarchical LLM Agents with Environment Preference Optimization (2024.emnlp-main)

Copied to clipboard

Qi Zhao, Haotian Fu, Chen Sun, George Konidaris

Challenge:	Long-horizon decision-making tasks require extensive planning over multiple steps, maintaining coherence and goal orientation, which is difficult for LLMs that are typically designed for more immediate and localized predictions.
Approach:	They propose a hierarchical framework that decomposes complex tasks into manageable subgoals, utilizing separate LLMs for subgoal prediction and low-level action generation.
Outcome:	The proposed framework achieves first place on the ALFRED public leaderboard and demonstrates its potential to improve long-horizon decision-making in diverse environments.

LLMs on a Budget? Say HOLA (2025.emnlp-industry)

Copied to clipboard

Zohaib Hasan Siddiqui, Jiechao Gao, Ebad Shabbir, Mohammad Anas Azeez, Rafiq Ali, Gautam Siddharth Kashyap, Usman Naseem

Information Retrieval

Challenge:	Current solutions such as quantization, pruning, and Retrieval-Augmented Generation (RAG) offer only partial optimizations and often sacrifice accuracy, speed, or generality.
Approach:	They propose an end-to-end optimization framework for efficient LLM deployment . it leverages Hierarchical Speculative Decoding (HSD) for faster inference without quality loss.
Outcome:	HOLA delivers +17.6% EMA on GSM8K, +10.5% MCA on ARC, and reduced latency and memory on edge devices like Jetson Nano.