Papers by Patric Tippmann
GottBERT: a pure German Language Model (2024.emnlp-main)
Copied to clipboard
Raphael Scheible, Johann Frei, Fabian Thomczyk, Henry He, Patric Tippmann, Jochen Knaus, Victor Jaravine, Frank Kramer, Martin Boeker
| Challenge: | Pre-trained language models have advanced natural language processing (NLP) despite the introduction of BERT, single-language models are still relevant. |
| Approach: | They present a German singlelanguage RoBERT model pre-trained exclusively on the German portion of the OSCAR dataset. |
| Outcome: | The GottBERT model outperforms the existing models on Named Entity Recognition and text classification tasks. |