Papers by Pinrui Yu
Pruning Foundation Models for High Accuracy without Retraining (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Despite the superior performance of foundation models, it is challenging to deploy large language models in practical applications due to their massive parameters and computations. |
| Approach: | They propose a pruning algorithm to prune LLMs in one-shot without retraining . they propose retrainable pruning algorithms to prune multiple weights in LLM . |
| Outcome: | The proposed pruning methods perform better than baseline pruning methods on sparse and unstructured sparsity models. |