Papers by Julia Wunderle
LLäMmlein: Transparent, Compact and Competitive German-Only Language Models from Scratch (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have achieved remarkable success, yet this progress is predominantly centered on English. |
| Approach: | They create two German-only decoder models from scratch and publish them for the (German) NLP research community to use. |
| Outcome: | The two models performed competitively on the German SuperGLEBer benchmark, but performance improvements plateaued early during training, offering valuable insights into resource allocation for future models. |