Editing Large Language Models: Problems, Methods, and Opportunities (2023.emnlp-main)
Copied to clipboard
Yunzhi Yao, Peng Wang, Bozhong Tian, Siyuan Cheng, Zhoubo Li, Shumin Deng, Huajun Chen, Ningyu Zhang
| Challenge: | Recent advances in model editing for LLMs have created challenges and opportunities for the community. |
| Approach: | They propose to alter the behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs. |
| Outcome: | The proposed method alters behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs. |
Similar Papers
Knowledge Editing for Large Language Models (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are not immune to issues of factual accuracy or logically consistent. |
| Approach: | This tutorial will present cutting-edge methods and practical tools for editing Large Language Models (LLMs). |
| Outcome: | The aim of this course is to familiarize researchers with the latest advancements and emerging strategies in the realm of knowledge editing for LLMs. |
Adaptation of Large Language Models (2025.naacl-tutorial)
Copied to clipboard
| Challenge: | a tutorial on adaptation of large language models addresses the growing demand for models that go beyond static capabilities. |
| Approach: | This tutorial will provide an overview of dynamic, domain-specific, and task-adaptive LLM adaptation techniques. |
| Outcome: | This tutorial will outline dynamic, domain-specific, and task-adaptive LLM adaptation techniques. |
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations (2024.emnlp-main)
Copied to clipboard
Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, Mizanur Rahman, Mohammad Abdullah Matin Khan, Haidar Khan, Israt Jahan, Amran Bhuiyan, Chee Wei Tan, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty, Jimmy Huang
| Challenge: | Large Language Models (LLMs) have gained significant attention due to their capabilities in performing diverse tasks across domains. |
| Approach: | They review the primary challenges and limitations causing inconsistencies in evaluations . early models could generate coherent text but limited to simple tasks . |
| Outcome: | The proposed evaluations are reproducible, reliable, and robust. |
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment. |
| Approach: | They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge. |
| Outcome: | The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses. |
Data and Model Centric Approaches for Expansion of Large Language Models to New languages (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | Existing LLMs mainly support English alongside a handful of high resource languages . this leaves a major gap for most low-resource languages despite increasing pace of research . |
| Approach: | This tutorial examines approaches to expand the language coverage of LLMs . they look at tokenizer training, pre-training, instruction tuning, alignment, evaluation, etc. |
| Outcome: | This tutorial examines approaches to expand the language coverage of LLMs . it provides an efficient and viable path to bring LLM technologies to low-resource languages . |
On the Robustness of Editing Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have exhibited impressive success and significant potential. |
| Approach: | They propose to modify the knowledge memory with minimum computational cost while preserving the performance on the retained knowledge. |
| Outcome: | The proposed methods avoid retraining to update the model parameters and have demonstrated promising performance and efficiency. |
Editing the Mind of Giants: An In-Depth Exploration of Pitfalls of Knowledge Editing in Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge editing is a promising technique for updating factual knowledge in large language models (LLMs) but studies have identified side effects such as knowledge distortion and the deterioration of general abilities that have emerged after editing. |
| Approach: | They propose to evaluate the side effects of knowledge editing in large language models using metrics and benchmarks. |
| Outcome: | The results of the study highlight the limitations of current knowledge editing methods and outline potential research directions. |
Enhancing LLM Capabilities Beyond Scaling Up (2024.emnlp-tutorials)
Copied to clipboard
| Challenge: | general-purpose large language models (LLMs) are expanding in scale and access to unpublic training data. |
| Approach: | This tutorial aims to examine the capabilities of general-purpose large language models . authors discuss adaptation of LLMs to address conflicts, defense against attacks . |
| Outcome: | This tutorial aims to examine the evolution of general-purpose large language models (LLMs) the authors argue that the evolution is dependent on the availability of training data and the scale of the models. |
Can We Edit Multimodal Large Language Models? (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to edit multimodal models have been used to incrementally infuse a language model with a new set of facts. |
| Approach: | They construct a benchmark for editing multimodal Large Language Models and establish metrics for evaluation. |
| Outcome: | The proposed benchmarks show that editing multimodal models is not as difficult as editing single-modal models. |
DocMEdit: Towards Document-Level Model Editing (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing models only output short phrases or sentences, raising doubts about their practical usability. |
| Approach: | They propose a dataset focused on document-level model editing that aims to correct errors and outdated knowledge in Large language models (LLMs) they propose to use document-based model editing to improve model capabilities in real-world scenarios. |
| Outcome: | The proposed model editing task improves model capabilities in real-world scenarios and reduces the cost of retraining. |