Papers by Katarína Benešová
Cost-effective Deployment of BERT Models in Serverless Environment (2021.naacl-industry)
Copied to clipboard
| Challenge: | a large upfront infrastructure investment makes machine learning models difficult to deploy . however, serverless architectures have strict limits on the size of the deployment package . |
| Approach: | They propose to fine-tune BERT-style models on proprietary datasets for tasks . they use knowledge distillation to obtain models that are tuned for a specific domain . |
| Outcome: | The proposed model deployments report acceptable latency levels and cost-effectiveness without infrastructure overhead. |