Papers by Aaron Thomas
Refining Salience-Aware Sparse Fine-Tuning Strategies for Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large language models require expensive training on consumer-grade hardwares. |
| Approach: | They propose a sparsity-based approach that introduces trainable sparse adaptations to the weight matrices in the model and offers greater flexibility in selecting fine-tuned parameters. |
| Outcome: | The proposed method outperforms other methods for a simple yet effective baseline for nLP tasks while sacrificing performance. |