Training and Evaluation of our German Electra Language Model Talk

Together with Philipp Reissel from ambeRoad I gave a talk about the training and evaluation of our open-source German Electra NLP language model.

Here we explain how to train and use language models in general. We tell what is done differently with our model or the tokenizer than with other models, explain the composition of our text corpus and illustrate the evaluation and comparison of the language model.

Slides and YouTube video are available:

  German colossal, cleaned Common Crawl corpus (GC4) released