About Me#
This is an overview of my open source models, datasets, projects and contributions.
Models#
German Electra NLP model, joined work with Philipp Reißel (ambeRoad)
Talk about this model:
BEYOND BERT – Challenges and Potentials in the Training of German Language Models
These models are trained on our GC4 corpus.
Joined work with Stefan Schweter (schweter.ml) and Philipp Schmid (Hugging Face).
This model is intended to compute sentence (text) embeddings for English and German text. These embeddings can then be compared with cosine-similarity to find sentences with a similar semantic meaning.
A bilingual summarization model for English and German. It is based on the multilingual T5 model google/mt5-small.
This is a German ELMo deep contextualized word representation. It is trained on a special German Wikipedia Text Corpus.
Datasets#
This dataset is intended for the evaluation of German RAG (retrieval augmented generation) capabilities of LLM models. It is based on the test set of the deutsche-telekom/wikipedia-22-12-de-dpr data set (also see wikipedia-22-12-de-dpr on GitHub) and consists of 4 subsets or tasks.
Ger-RAG-eval is also implemented in LightEval:
This dataset provides a German dataset for DPR model training. DPR (Dense Passage Retrieval) is one of the most important components of RAG applications. Based on this dataset, German document retrieval models can be trained.
The unique feature of this data set is that it contains not only training data for questions, but also imperative questions. An imperative question is a type of question that is phrased as a command or an instruction. Since there is a formal and informal form of address in German, both cases are included in the case of imperative questions.
This is a German text corpus which is based on Common Crawl. The text corpus has the size of 454 GB packed. Unpacked it is more than 1 TB. It has been cleaned up and preprocessed and can be used for various tasks in the NLP field. The dataset is joined work with Philipp Reißel (ambeRoad).
Machine translated multilingual translations and
the English original of the STSbenchmark dataset.
Translation has been done with deepl.com.
This dataset is available on GitHub and
as a Hugging Face Dataset.
This is a dataset of more than 21 million German paraphrases. These are text pairs that have the same meaning but are expressed with different words. This dataset can be used for example to train semantic text embeddings. To do this, for example, SentenceTransformers and the MultipleNegativesRankingLoss can be used.
Tools to extract and clean the Wikipedia texts to transform them into a text corpus for self-supervised NLP model training. Includes also a prepared corpus for English and German language.
This repository contains two datasets:
A labeled multi-domain (21 domains) German and English dataset with 25K user utterances for human-robot interaction. It is also available as a Hugging Face dataset: deutsche-telekom/NLU-Evaluation-Data-en-de
A dataset with 1,127 German sentence pairs with a similarity score. The sentences originate from the first data set.
This is a few-shot training dataset from the domain of human-robot interaction. It contains texts in German and English language with 64 different utterances (classes). Each utterance (class) has exactly 20 samples in the training set. This leads to a total of 1280 different training samples.
The dataset is intended to benchmark the intent classifiers of chat bots in English and especially in German language. We are building on our deutsche-telekom/NLU-Evaluation-Data-en-de data set.
Projects#
A box of different machine learning tools. It contains tools for:
data loading,
fastText, files, Markdown,
Markdown,
OpenAI,
Optuna, plot,
SoMaJo,
text cleaning,
Transformers
Models and training code for cross-lingual sentence representations like T-Systems-onsite/cross-en-de-roberta-sentence-transformer
This Python package implements tools for LightGBM. In the current version lightgbm-tools focuses on binary classification metrics.
Tools for machine learning in cloud environments. At the moment it is only a tool to easily handle Amazon S3.
This project uses the census income data and fits LightGBM models on it. It is not intended to bring super good results, but rather as a demo to show the interaction between LightGBM, Optuna and HPOflow. The usage of HPOflow is optional and can be removed if wanted. We also calculare the feature importances with SHAP (SHapley Additive exPlanations).
smart-prom-next is a Prometheus metric exporter for S.M.A.R.T. values of hard disks.
The MLflow Docker image.
MLflow does not provide an official Docker image. This project fills that gap.
Python tool to support lazy imports
This is Black for Python docstrings and reStructuredText (rst). It can be used to format docstrings (Google docstring format) in Python files or reStructuredText.
conda-forge release of Hyperopt
Pull Requests#
google-research/electra: add toggle to turn off
strip_accents
#88opensearch-project/opensearch-py: add Sphinx to generate Code Documentation #112 - also see API Reference
hyperopt/hyperopt: add progressbar with tqdm #455
mlflow/mlflow: add possibility to use client cert. with tracking API #2843
Archived Projects#
This is the machine learning tool box. A collection of userful machine learning tools intended for reuse and extension. The toolbox contains the following modules: hyperopt, keras, lightgbm, shap, metrics, plot, tools
The main functionality is now available in MLTB2.
Tools for Hugging Face / Transformers