Challenge: Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents.
Approach: They propose a framework that separates tactical execution, strategic oversight, and context organization into three specialized components.
Outcome: The proposed framework improves accuracy by 20% relative to baselines on GAIA, BrowseComp, and Humanity’s Last Exam tasks.

Similar Papers

PACE: Predictive Adaptive Context Extraction for Long-Horizon LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents struggle with ultra-long-horizon tasks requiring hundreds or thousands of interaction steps.
Approach: They propose a framework that reconceptualizes context management as a Next Step Prediction problem.
Outcome: The proposed framework improves task success rates and robust cross-lingual performance.
PRISM: Efficient Long-Range Reasoning With Short-Context LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing solutions to long-range language tasks require large compute budgets and complex task-specific design choices.
Approach: They propose an in-context method that uses structured schemas to generate short-contemporary outputs.
Outcome: a new in-context method outperforms baselines on diverse tasks with 4x shorter contexts . it scales down to tiny contexts without increasing costs or sacrificing quality .
Tree of Agents: Improving Long-Context Capabilities of Large Language Models through Multi-Perspective Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models face persistent challenges when handling long-context tasks . existing methods that reduce input have the risk of discarding key information .
Approach: To address this issue, we propose a multi-agent reasoning framework called Tree of Agents . the framework segments input into chunks processed by independent agents .
Outcome: The proposed model outperforms baseline models on long-context tasks.
Context as a Tool: Context Management for Long-Horizon SWE-Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models rely on append-only context maintenance or passively triggered compression heuristics, leading to context explosion, semantic drift, and degraded reasoning in long-running interactions.
Approach: They propose a new context management paradigm that elevates context maintenance to a callable tool . they propose 'cat' framework that injects context-management actions into complete interaction trajectories .
Outcome: The proposed model outperforms ReAct-based agents and static compression baselines on SWE-Verified tests.
InfiAgent: An Infinite-Horizon Framework for General-Purpose Autonomous Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs break down on long-horizon tasks due to unbounded context growth and accumulated errors.
Approach: They propose a framework that externalizes persistent state into a file-centric state abstraction and keeps the agent’s reasoning context strictly bounded regardless of task duration.
Outcome: Experiments on DeepResearch and an 80-paper literature review show that the proposed framework maintains higher long-horizon coverage than baseline models without task-specific fine-tuning.
Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools (2025.acl-long)

Copied to clipboard

Challenge: Existing reasoning methods excel in structured domains like math and code, but they are not all effective in knowledge-intensive tasks.
Approach: They introduce a framework that enhances large language model reasoning by integrating external tool-using agents.
Outcome: The proposed framework achieves state-of-the-art among public models and delivers comparable performance to OpenAI Deep Research.
ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to managing context are based on raw accumulation or passive summarization, treating it as static artifact and allowing early errors or misplaced emphasis to persist.
Approach: They propose a framework that treats context as a dynamic internal reasoning state during execution.
Outcome: Experiments on long-horizon information-seeking benchmarks show that ARC outperforms passive context compression methods.
MemWeaver: Weaving Hybrid Memories for Traceable Long-Horizon Agentic Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods rely on unstructured retrieval or coarse abstractions, which lead to temporal conflicts, brittle reasoning, and limited traceability.
Approach: They propose a unified memory framework that consolidates long-term agent experiences into three interconnected components that combine structured knowledge and evidence to construct compact yet information-dense contexts for reasoning.
Outcome: The proposed framework significantly improves multi-hop and temporal reasoning accuracy while reducing input context length by over 95% compared to long-context baselines.
A Joint Optimization Framework for Enhancing Efficiency of Tool Utilization in LLM Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing efforts for tool utilization involve an LLM agent that contains instructions on using the description of the available tools to determine and call the tools required to solve the problem.
Approach: They propose to optimize the context of LLM agents by combining the instructions provided in agent prompts and tool descriptions to enhance their interaction.
Outcome: The proposed framework improves both the instructions provided in agent prompt and tool description, enhancing their interaction.
Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for storing and retrieving memory are limited by shallow semantic retrieval.
Approach: They propose a memory mechanism that organizes and retrieves past experiences to support decision-making.
Outcome: Experiments on LoCoMo and NarrativeQA show that CompassMem improves retrieval and reasoning performance across multiple backbone models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations