Papers by Saleh Alharbi
Multi-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling (2025.acl-long)
Copied to clipboard
Junlin Li, Guodong Du, Jing Li, Sim Kuan Goh, Wenya Wang, Yequan Wang, Fangming Liu, Ho-Kin Tang, Saleh Alharbi, Daojing He, Min Zhang
| Challenge: | Large Language Models (LLMs) are a cornerstone in artificial intelligence due to their exceptional performance. |
| Approach: | They propose a training-free approach that integrates existing MLLMs for effective multimodal expansion while retaining their original performance. |
| Outcome: | The proposed approach can expand LLMs' multimodal capabilities while retaining original performance. |
Safety Alignment via Constrained Knowledge Unlearning (2025.acl-long)
Copied to clipboard
Zesheng Shi, Yucheng Zhou, Jing Li, Yuxin Jin, Yu Li, Daojing He, Fangming Liu, Saleh Alharbi, Jun Yu, Min Zhang
| Challenge: | Existing defense mechanisms have not fully deleted harmful knowledge in large language models (LLMs) Existing methods to address safety alignment have not completely deleted harmful information in LLMs. |
| Approach: | They propose a safety alignment strategy that uses scoring neurons to identify useful knowledge in LLMs and pruning the gradients of neurons in U to preserve beneficial information. |
| Outcome: | The proposed method significantly improves model safety while maintaining utility compared to existing methods. |