Papers by Dmitry Baranchuk
Petals: Collaborative Inference and Fine-tuning of Large Models (2023.acl-demo)
Copied to clipboard
Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers, Maksim Riabinin, Younes Belkada, Artem Chumachenko, Pavel Samygin, Colin Raffel
| Challenge: | Recent studies show that pretrained language models can solve practical tasks using more than 100 billion parameters. |
| Approach: | They propose a system for inference and fine-tuning of large models collaboratively by joining the resources of multiple parties. |
| Outcome: | The proposed system outperforms offloading for very large models running on consumer GPUs with 1 step per second, enough for many interactive LLM applications. |