Challenge: Existing knowledge editing methods for large language models struggle to maintain logical consistency when propagating ripple effects to associated facts.
Approach: They propose a framework that synergizes knowledge graph-derived logical rules with LLM logical reasoning capabilities to enable systematic chain updates.
Outcome: The proposed framework improves logical generalization and specificity while maintaining reliability and specificness.

Similar Papers

RippleCOT: Amplifying Ripple Effect of Knowledge Editing in Language Models via Chain-of-Thought In-Context Learning (2024.findings-emnlp)

Copied to clipboard

Challenge: et al., 2022: ripple effect challenges knowledge editing for large language models.
Approach: They propose a method to improve the accuracy of large language models by integrating Chain-of-Thought reasoning into the ICL editing approach.
Outcome: RIPPLE-COT outperforms the state-of-the-art on the ripple effect, with gains ranging from 7.8% to 87.1%.
Why Does New Knowledge Create Messy Ripple Effects in LLMs? (2024.emnlp-main)

Copied to clipboard

Challenge: Existing research has focused on post-training knowledge editing (KE) for language models to ensure that knowledge remains accurate and up-to-date.
Approach: They propose to use a GradSim indicator to detect when and why updated knowledge ripples in language models.
Outcome: The proposed indicator GradSim shows that LMs that fail to handle ripple effects have low GradSIM.
Knowledge Editing through Chain-of-Thought (2025.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge editing methods focus on multi-hop QA tasks and require frequent retraining.
Approach: They propose a new knowledge editing framework that updates large language models with new information to maintain their world knowledge without retraining.
Outcome: The proposed method achieves state-of-the-art performance while offering superior generalization, effectiveness, and stability compared to existing methods.
Robust Knowledge Editing via Explicit Reasoning Chains for Distractor-Resilient Multi-Hop QA (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models encode vast amounts of knowledge but remain static once trained, making timely integration of emerging facts prohibitively expensive via full retraining.
Approach: They introduce a reasoning-chain-based editing framework that steers a pretrained LLM through four structured stages to filter distractors in a single pass.
Outcome: The proposed framework steers a pretrained LLM through four structured stages to filter distractors in a single pass.
LLMs as Knowledge Graph Refiners: Mitigating Factual Inconsistencies in Generative Knowledge Extraction (2026.acl-long)

Copied to clipboard

Challenge: Knowledge graphs (KGs) represent real-world entities and their relations in a structured form.
Approach: They propose a framework that performs triple-level refinement on KGs constructed via GKE.
Outcome: The proposed framework improves KG quality from diverse perspectives.
DICE: Structured Reasoning in LLMs through SLM-Guided Chain-of-Thought Correction (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) often prioritize reasoning over adherence to detailed instructions due to high computational costs and limited parameter access.
Approach: They propose a lightweight framework that guides small language models to refine LLMs’ outputs through chain-of-thought correction.
Outcome: The proposed framework improves the average format accuracy and content correctness of LLM outputs by 35.4% and 29.4%, respectively, achieving state-of-the-art (SOTA) performance over other competitive baselines.
RuleEdit: Towards Rule-Level Knowledge Generalization to Mitigate Over-Editing in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing knowledge editing methods focus on instance-level editing, which is prone to knowledge degradation and general ability deterioration due to redundant instance-specific modifications.
Approach: They propose a rule-level editing method that generalizes rule-derived knowledge to update rule-based instances.
Outcome: The proposed method improves portability and performance over baselines for LLaMA-2-7B on RULEmix.
EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models (2024.acl-demos)

Copied to clipboard

Challenge: Large Language Models (LLMs) suffer from knowledge cutoff or fallacy issues, which means they are unaware of unseen events or generate text with incorrect facts owing to outdated/noisy data.
Approach: They propose an easy-to-use knowledge editing framework for Large Language Models that allows users to easily edit updated knowledge and adjust undesired behavior while minimizing the impact on unrelated inputs.
Outcome: The proposed framework surpasses traditional fine-tuning in terms of reliability and generalization.
CLaRE-ty Amid Chaos: Quantifying Representational Entanglement to Predict Ripple Effects in LLM Editing (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are outdated or incorrect over time due to unintended ripple effects that propagate even to the hidden space.
Approach: They propose a lightweight representation-level technique to identify where ripple effects may occur by detecting entanglement between facts using forward activations from a single intermediate layer.
Outcome: The proposed method achieves 62.2% improvement in Spearman correlation with ripple effects while being 2.74 faster and using 2.85 less peak GPU memory.
Learning to Edit Knowledge via Instruction-based Chain-of-Thought Prompting (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge editing methods focus on structured fact triples, overlooking diverse unstructured forms of factual information.
Approach: They propose a method that allows LLMs to edit knowledge via **Chain of Thoughts** reasoning.
Outcome: The proposed method achieves strong generalization across six diverse knowledge editing scenarios with a single round of training on three open-source language models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations