Projects
Projects I am currently working on.
Hugging Face LLM Inference Container
Technical/Engineering Lead
Hugging Face LLM DLC is a new purpose-built Inference Container to easily deploy LLMs in a secure and managed environment.
Learn more →IGEL - instruction-tuned German large Language Model
Creator
IGEL (Instruction-based German Language Model) is an LLM designed for German language understanding tasks, including sentiment analysis, language translation, and question answering.
Learn more →🤗 Inference Endpoints
Creator & Technical Lead
🤗 Inference Endpoints is a secure production solution to easily deploy ML models on dedicated, secure & scalable infrastructure.
Learn more →Hugging Face Endpoints on Azure
Technical Lead
Hugging Face Endpoints, a new Machine Learning (ML) inference service powered by Azure ML Managed Endpoints. Hugging Face Endpoints let you securely deploy and scale tens of thousands of state-of-the-art Transformer models on Microsoft Azure with just a few clicks.
Learn more →Hugging Face Infinity
Technical Lead
A containerized solution to deploy fully optimized inference pipelines for State of the Art Transformer models into your own production environment at 1ms latency.
Learn more →🤗 Transformers
Contributor
🤗 Transformers provides thousands of pretrained transformer models to perform tasks on text, vision and speech.
Learn more →🤗 Optimum
Core-Contributor
🤗 Optimum is an extension of Hugging Face Transformers to achieve maximum efficiency to train and run models on accelerated hardware, including toolkits for optimized performance on Graphcore IPU and Habana Gaudi.
Learn more →🤗 Datasets
Contributor
🤗 Datasets is a library for easily accessing and sharing datasets, and evaluation metrics for Natural Language Processing (NLP), computer vision, and audio tasks.
Learn more →Transformers Notebook
Maintainer
A collection of Jupyter Notebooks guiding, showcasing, and helping you get started with Hugging Face Transformers on Amazon SageMaker including Basic Getting Started up to Distributed Training.
Learn more →SageMaker Hugging Face Inference Toolkit
Maintainer
SageMaker Hugging Face Inference Toolkit is an open-source library for serving 🤗 Transformers models on Amazon SageMaker.
Learn more →AWS Deep Learning Container
HF Contributor
AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in Hugging Face Transformers, TensorFlow, TensorFlow 2, PyTorch, and MXNet.
Learn more →AWS CDK - Samples
Maintainer
This repository contains a set of example projects for Deep Learning Cloud Native Applications using the AWS Cloud Development Kit.
Learn more →