HiEdit: Lifelong Model Editing with Hierarchical Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to lifelong model editing apply parameter perturbations to static and dense layers for all instances. |
| Approach: | They propose a hierarchical reinforcement learning framework that identifies the most knowledge-relevant layers for each editing instance. |
| Outcome: | The proposed framework boosts the performance of the competitive RLEdit by 8.48% with perturbing only half of the layers per edit. |
Similar Papers
Think and Recall: Layer-Level Prompting for Lifelong Model Editing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for lifelong model editing suffer from limitations in usability, such as requiring additional training corpora or lacking support for reversible and detachable edits. |
| Approach: | They propose a plug-and-play method for knowledge retrieval and storage, i.e., Layer-Level Prompting, which enables seamless and efficient lifelong model editing. |
| Outcome: | The proposed method outperforms existing methods on question answering and hallucination benchmarks across different LLMs. |
MicroEdit: Neuron-level Knowledge Disentanglement and Localization in Lifelong Model Editing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing large language models are designed for single or limited edits, lacking the capacity to support long-term, multi-round knowledge updates. |
| Approach: | They propose a neuron-level editing method that performs minimal interventions within large language models (LLMs) by leveraging a sparse autoencoder, MicroEdit disentangles knowledge representations and activates only a minimal set of necessary neurons for precise parameter updates. |
| Outcome: | Extensive experiments show that MicroEdit outperforms prior methods and robustly handles lifelong knowledge editing across QA and Hallucination settings on LLaM and Mistral. |
RuleEdit: Towards Rule-Level Knowledge Generalization to Mitigate Over-Editing in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge editing methods focus on instance-level editing, which is prone to knowledge degradation and general ability deterioration due to redundant instance-specific modifications. |
| Approach: | They propose a rule-level editing method that generalizes rule-derived knowledge to update rule-based instances. |
| Outcome: | The proposed method improves portability and performance over baselines for LLaMA-2-7B on RULEmix. |
HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks (2026.findings-acl)
Copied to clipboard
Yiming Zeng, Jinghan Cao, Zexin Li, Wanhao Yu, Zhankai Ye, Dawei Xiang, Ting Hua, Xin Liu, Shangqian Gao, Tingting Yu
| Challenge: | Existing approaches treat instruction-based text editing as a generic text generation problem. Existing methods either over-edit or fail to apply modifications consistently. |
| Approach: | They propose a framework that processes each editing request to best align with it. |
| Outcome: | The proposed framework achieves 9% improvement over the state-of-the-art model. |
Representation Interventions Enable Lifelong Knowledge Memory Control in LLMs (2026.acl-long)
Copied to clipboard
Xuyuan Liu, Shengyu Chen, Xinshuai Dong, Yanchi Liu, Xujiang Zhao, Haoyu Wang, Yujun Yan, Haifeng Chen, Zhengzhang Chen
| Challenge: | Large language models (LLMs) produce outdated or inaccurate content. Updating their knowledge efficiently and accurately without costly retraining is a major challenge. |
| Approach: | They propose a robust and scalable method that treats knowledge control as interventions within the model’s representation space. |
| Outcome: | The proposed method achieves fine-grained control over complex, unstructured knowledge while maintaining general utility with frozen base weights. |
Knowledge Decoupling via Orthogonal Projection for Lifelong Editing of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for enhancing large language models (LLMs) have achieved some success, but their knowledge understanding and memory capacity significantly degrades after extensive editing. |
| Approach: | They propose a method that stores the basis vectors of the representation space of past edits in a knowledge cache and projects the gradient of the current edit onto a space orthogonal to previous knowledge for updating. |
| Outcome: | The proposed method improves question-answering ability and hallucination mitigation by 14% and 61% for large language models after 3,000 edits. |
Relaxing the Constraints: A Dual-Importance Projection Mechanism for Lifelong Model Editing (2026.findings-acl)
Copied to clipboard
Zhenghai Chen, Senbin Xu, Jiaxi Tan, Xinhua Wu, Yan Zhang, Xiawu Zheng, Shengchuan Zhang, Ke Li, Sicheng Zhao, Liujuan Cao, Rongrong Ji
| Challenge: | Existing knowledge editing methods rely on strict orthogonal projection to preserve previously edited knowledge, but this constraint limits gradient expressiveness, resulting in degradation of model generalization and overall performance as the number of edits increases. |
| Approach: | They propose a method that leverages Singular Value Decomposition to identify critical gradient subspaces and introduces a dual mechanism comprising "accumulated importance" and "projection importance" |
| Outcome: | Extensive experiments on five mainstream LLMs show that the proposed method achieves an average comprehensive performance improvement of 10.36% and effectively maintains the model’s general capabilities on downstream tasks. |
QueueEDIT: Structural Self-Correction for Sequential Model Editing in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models (LLMs) can be effective for correcting factual inaccuracies but can still suffer from hallucinations. |
| Approach: | They propose a queue-based self-correction framework that addresses parameter bias during sequential model editing. |
| Outcome: | The proposed framework outperforms baseline models while maintaining competitive performance in single-turn editing. |
Towards Scalable Lifelong Knowledge Editing with Selective Knowledge Suppression (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to modify knowledge are limited due to high training costs and lack stability during sequential edits due to catastrophic forgetting. |
| Approach: | They propose a framework to modify specific knowledge of large language models without retraining the entire model. |
| Outcome: | Extensive experiments on ZSRE, Counterfact, and RIPE show that LightEdit outperforms existing lifelong knowledge editing methods. |
Lifelong Model Editing with Graph-Based External Memory (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for post-training model editing suffer from overfitting and catastrophic forgetting. |
| Approach: | They propose a framework that leverages hyperbolic geometry and graph neural networks for precise and stable model edits. |
| Outcome: | Experiments on CounterFact, CounterFACT+, and MQuAKE with GPT2-XL and GPT-J show that HYPE significantly enhances edit stability, factual accuracy, and multi-hop reasoning. |