Papers by Tajana Rosing
TrimLLM: Progressive Layer Dropping for Domain-Specific LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | specialized language models do not show simultaneous memory saving and inference speedup at deployment time. |
| Approach: | They develop a layer-wise specialization technique that reduces the depth of LLMs by progressive layer dropping and compares it to other algorithms for inference. |
| Outcome: | The proposed model retains LLMs’ capacity in specific domains and achieves inference speedup irrespective of hardware and deep learning frameworks. |