Papers by Zhaomin Wu
Federated Data-Efficient Instruction Tuning for Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing federated learning (FL) uses all local data, causing excessive computational overhead and overfitting to local data. |
| Approach: | They propose a federated data-efficient instruction tuning approach which utilizes a representative subset of edge-side data to tune LLMs. |
| Outcome: | The proposed method improves Rouge-L on unseen tasks by 10.72% over the SOTA full-data instruction tuning methods while using less than 1.5% of the data samples. |
Model-based Large Language Model Customization as Service (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language model services require users to upload data for fine-tuning . current methods for customization are noisy and require sensitive domain data . |
| Approach: | *Llamdex is a framework that facilitates LLM customization as a service . client uploads pre-trained domain-specific *models* rather than data . |
| Outcome: | *Llamdex* framework improves domain-specific accuracy by up to 26% over state-of-the-art private data synthesis methods . |