Papers by Pin-Zu Li
Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages (2024.acl-long)
Copied to clipboard
Shih-Cheng Huang, Pin-Zu Li, Yu-chi Hsu, Kuang-Ming Chen, Yu Tung Lin, Shih-Kai Hsiao, Richard Tsai, Hung-yi Lee
| Challenge: | Despite the rapid development of large language models, the language capabilities of most open-source LLMs are primarily focused on English due to data constraints. |
| Approach: | They propose a chat vector to equip pre-trained language models with instruction following and human value alignment via simple model arithmetic. |
| Outcome: | The proposed method can be extended to include various languages, base models, and chat vectors. |