Papers by Zuev Aleksandr
GIFT-SW: Gaussian noise Injected Fine-Tuning of Salient Weights for LLMs (2025.acl-long)
Copied to clipboard
Maxim Zhelnin, Viktor Moskvoretskii, Egor Shvetsov, Maria Krylova, Venediktov Egor, Zuev Aleksandr, Evgeny Burnaev
| Challenge: | Recent studies show that a small subset of weights significantly impacts performance. |
| Approach: | They propose a Gaussian noise-injected fine-tuning method that updates only salient weights while injecting Gausssian into non-salient weight. |
| Outcome: | The proposed method outperforms full fine-tuning and PEFT methods under the same computational budget. |