| Challenge: | Existing tasks to assess LMs’ efficacy as KBs do not adequately consider multiple large-scale updates. |
| Approach: | They propose a task where multiple large-scale updates are made to language models and plug-in modules are used to handle the updates. |
| Outcome: | The proposed method outperforms existing methods on zsRE QA and NQ datasets and is 4x more effective in terms of updates/forgets ratio compared to a fine-tuning baseline. |
Similar Papers
GrowOVER: How Can LLMs Adapt to Growing Real-World Knowledge? (2024.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge-based datasets are outdated due to the rapid evolution of knowledge. |
| Approach: | They propose a retrieval-interactive language model framework that evaluates and reflects on its answers for further re-retrieval. |
| Outcome: | The proposed framework performs comparably to or surpasses continuously trained language models. |
Carpe diem: On the Evaluation of World Knowledge in Lifelong Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Current language models are trained on static data, implying that the encoded knowledge could go wrong as time passes. |
| Approach: | They propose a temporally evolving question-answering benchmark for language models . they use Wikipedia databases to test language models for dynamic knowledge in ever-changing world . |
| Outcome: | The proposed task aims to model the evolution-adaptability of language models in the real world. |
One for All: Update Parameterized Knowledge Across Multiple Models with Once Edit (2025.acl-long)
Copied to clipboard
Weitao Ma, Xiyuan Du, Xiaocheng Feng, Lei Huang, Yichong Huang, Huiyi Zhang, Xiaoliang Yang, Baohang Li, Xiachong Feng, Ting Liu, Bing Qin
| Challenge: | Existing methods for modifying large language models focus on individual models, resulting in errors and hallucinations. |
| Approach: | They propose an ensemble-based approach that employs a plug-in model as the editing module and a dynamic weight mechanism to enhance its effectiveness. |
| Outcome: | The proposed approach outperforms existing methods while achieving superior editing efficiency. |
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark (2025.coling-main)
Copied to clipboard
Zhikun Xu, Yinghui Li, Ruixue Ding, Xinyu Wang, Boli Chen, Yong Jiang, Haitao Zheng, Wenlian Lu, Pengjun Xie, Fei Huang
| Challenge: | Recent work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer dynamic questions well. |
| Approach: | They propose a Chinese Dynamic QA benchmark containing question-answer pairs related to the latest dynamic questions on the Chinese Internet. |
| Outcome: | The proposed benchmark will be one of the key data resources for improving LLMs’ Chinese question-answering ability in the future. |
Continual Learning of Large Language Models (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial explores the challenges of continual learning in large language models . participants will learn strategies to mitigate forgetting and manage data and evaluation pipelines . |
| Approach: | This tutorial offers a comprehensive exploration of continual learning in the context of large language models. |
| Outcome: | This tutorial explores the challenges of continual learning in large language models . participants will learn how to manage data and evaluation pipelines and adapt responsibly . |
ACBQ: Adaptive Cross-Block Quantization of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for post-training quantization struggle to support weight–activation joint quantization and extreme low-bit weight quantization. |
| Approach: | They propose a framework that addresses weight–activation joint quantization and extreme weight quantization. |
| Outcome: | The proposed framework achieves superior performance under both W4A4 and highly aggressive W2 settings while incurring negligible additional computational overhead. |
KG-MuLQA: A Framework for KG-based Multi-Level QA Extraction and Long-Context LLM Evaluation (2026.acl-long)
Copied to clipboard
Nikita Tatarinov, Vidhyakshaya Kannan, Haricharana Srinivasa, Arnav Raj, Harpreet Singh Anand, Varun Singh, Aditya Luthra, Ravij Lade, Agam Shah, Sudheer Chava
| Challenge: | KG-MulQA extracts QA pairs at multiple complexity levels along three key dimensions: multi-hop retrieval, set operations, and answer plurality. |
| Approach: | They propose a framework that extracts QA pairs at multiple complexity levels along three key dimensions: multi-hop retrieval, set operations, and answer plurality. |
| Outcome: | The framework extracts QA pairs at multiple complexity levels along key dimensions . it enables fine-grained assessment of model performance across controlled difficulty levels. |
Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Knowledge base question answering (KBQA) is a challenging task, particularly in parsing intricate questions into executable logical forms. |
| Approach: | They propose a framework to generate logical forms through direct interaction with knowledge bases (KBs) by annotating a dataset with step-wise reasoning processes. |
| Outcome: | The proposed framework achieves competitive results on the WebQuestionsSP, ComplexWebQuestIONS, KQA Pro, and MetaQA datasets with a minimal number of examples (shots). Importantly, the proposed model supports manual intervention, allowing for the iterative refinement of LLM outputs. |
LOKA: Conflict-Aware LLM Knowledge Update with Adaptive Knowledge Memory (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches that tackle unlearning and learning separately encounter *task conflicts* and *knowledge management issues* when applied to comprehensive knowledge updates. |
| Approach: | They propose a conflict-aware framework for Large language mOdel Knowledge updAtes that integrates updated knowledge across multiple memory units during training and integrates it with original LLM. |
| Outcome: | The proposed framework is based on theoretical analysis and empirical evidence and validates the proposed framework with empirical and theoretical evidence. |
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)
Copied to clipboard
Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen
| Challenge: | Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks. |
| Approach: | They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
| Outcome: | The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |