How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior (2026.acl-long)
Copied to clipboard
Zidi Xiong, Yuping Lin, Wenya Xie, Pengfei He, Zirui Liu, Jiliang Tang, Himabindu Lakkaraju, Zhen Xiang
| Challenge: | In practice, memory designs vary widely across agents due to their diverse objectives and functionalities. |
| Approach: | They conduct an empirical study on how memory management choices impact the LLM agents’ behavior, especially their long-term performance. |
| Outcome: | The proposed methods show that LLM agents display an experience-following property, which results in highly similar agent outputs. |
Similar Papers
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026.findings-acl)
Copied to clipboard
Jinghao Luo, Yuchen Tian, Chuxue Cao, Ziyang Luo, Hongzhan Lin, Kaixin Li, Chuyi Kong, Ruichao Yang, Jing Ma
| Challenge: | Large Language Models (LLMs)-based agents have fundamentally reshaped artificial intelligence . however, the inherent statelessness of LLMs hinders their ability to maintain logical consistency across complex, multi-step tasks . |
| Approach: | They propose a framework for LLM agent memory mechanisms that formalizes the development process into three stages: storage, reflection, and experience. |
| Outcome: | The proposed framework breaks the development process into three stages . it analyzes the need for long-range consistency, challenges in dynamic environments, and the ultimate goal of continual learning. |
Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods handle long-term memory (LTM) and short-term (STM) as separate components, relying on heuristics or auxiliary controllers, which limits adaptability and end-to-end optimization. |
| Approach: | They propose a framework that integrates LTM and STM management directly into the agent's policy and propose 'agentic memory' to train such unified behaviors. |
| Outcome: | The proposed framework outperforms strong memory-augmented baselines on five long-horizon benchmarks and achieves higher-quality long-term memory and more efficient context usage. |
Memp: Exploring Agent Procedural Memory (2026.findings-acl)
Copied to clipboard
Runnan Fang, Yuan Liang, Xiaobin Wang, Jialong Wu, Shuofei Qiao, Pengjun Xie, Fei Huang, Huajun Chen, Ningyu Zhang
| Challenge: | Large Language Models (LLMs) based agents suffer from brittle procedural memory that is manually engineered or entangled in static parameters. |
| Approach: | They propose a procedural-memory repository that distills past agent trajectories into fine-grained, step-by-step instructions and higher-level, script-like abstractions. |
| Outcome: | The proposed repository can be used to improve agents' performance on travelplanner and Alfworld. |
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)
Copied to clipboard
Zisu Huang, Muzhao Tian, Xiaohua Wang, Jingwen Xu, Zhengkang Guo, Qi Qian, Kaitao Song, Jiakang Yuan, Changze Lv, Xiaoqing Zheng
| Challenge: | Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies. |
| Approach: | They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt. |
| Outcome: | The proposed model outperforms prompting and memory masking strategies in multiple scenarios. |
MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have highlighted the significance of memory mechanisms in LLM-based agents, which enable them to store observed information and adapt to dynamic environments. |
| Approach: | They propose a dataset and benchmark to evaluate the memory capability of LLM-based agents from multiple aspects including their effectiveness, efficiency, and capacity. |
| Outcome: | The proposed benchmark incorporates factual memory and reflective memory as different levels, and proposes participation and observation as various interactive scenarios. |
Preference-Aware Memory Update for Long-Term LLM Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for integrating long-term memory do not provide dynamic and personalized memory refinement. |
| Approach: | They propose a long-term memory update mechanism that enables dynamic and personalized memory refinement. |
| Outcome: | The proposed mechanism improves the performance of LLM-based agents in five tasks. |
Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning (2026.acl-long)
Copied to clipboard
Sikuan Yan, Xiufeng Yang, Zuchao Huang, Ercong Nie, Zifeng Ding, Zonggen Li, Xiaowen Ma, Jinhe Bi, Kristian Kersting, Jeff Z. Pan, Hinrich Schuetze, Volker Tresp, Yunpu Ma
| Challenge: | Large Language Models (LLMs) are stateless and limited by a finite context window, preventing them from maintaining knowledge across long conversations or evolving tasks. |
| Approach: | They propose a reinforcement learning framework that empowers LLMs to actively manage external memory through two specialized agents. |
| Outcome: | The proposed framework outperforms baselines and benchmarks across diverse question types, three benchmarks, and multiple model scales. |
From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks frame long-term memory evaluation as fact retrieval from past conversations, providing limited insight into agents’ ability to consolidate memory over time or handle frequent knowledge updates. |
| Approach: | They propose a long-term memory benchmark that evaluates three memory-grounded tasks: remembering, reasoning, and recommending. |
| Outcome: | The proposed benchmarks evaluate three tasks: remembering, reasoning, and recommending. |
PersonaAgent: Bridging Memory and Action for Personalized LLM Agents (2026.findings-acl)
Copied to clipboard
Weizhi Zhang, Xinyang Zhang, Chenwei Zhang, Liangwei Yang, Jingbo Shang, Zhepei Wei, Henry Peng Zou, Zijie Huang, Zhengyang Wang, Yifan Gao, Xiaoman Pan, Lian Xiong, Jingguo Liu, Philip S. Yu, Xian Li
| Challenge: | Existing Large Language Model (LLM) enabled agents lack flexibility to respond to users’ varying needs and preferences. |
| Approach: | They propose a test-time user-preference alignment strategy that optimizes the persona prompt, ensuring real-time preference alignment through textual loss feedback between simulated and ground-truth responses. |
| Outcome: | The proposed framework outperforms baseline methods in real-time and in real applications. |
Unveiling Privacy Risks in LLM Agent Memory (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Model (LLM) agents store private user-agent interactions in memory for demonstrations, introducing new privacy risks for LLM agents. |
| Approach: | They propose an attack that extracts private information from memory under a black-box setting and propose a method that can be used to attack the agent. |
| Outcome: | The proposed attack is effective under a black-box setting and it is demonstrated on two representative agents. |