Papers by Daniel Mela
Mass-Editing Memory with Attention in Transformers: A cross-lingual exploration of knowledge (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have explored methods for updating and modifying factual knowledge in large language models, often focusing on specific multi-layer perceptron blocks. |
| Approach: | They propose a method that allows users to edit factual associations without catastrophic forgetting. |
| Outcome: | The proposed method achieves 10% increase in magnitude metrics while requiring minimal parameter modifications. |