Papers by Samiul Alam
SVD-LLM V2: Optimizing Singular Value Truncation for Large Language Model Compression (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for compressing Large Language Models suffer from significant truncation losses. |
| Approach: | They propose a novel method that optimizes singular value truncation in SVD compression . they use dynamic compression ratio allocation to balance the large tuncation loss . |
| Outcome: | The proposed method outperforms current state-of-the-art methods on ten datasets and five models on various scales. |