Published onJuly 13, 2023Train LLMs using QLoRA on Amazon SageMaker#GenerativeAI#HuggingFace#LLM#SageMakerLearn how to train LLMs using QLoRA on Amazon SageMakerRead more →
Published onJuly 4, 2023Deploy LLMs with Hugging Face Inference Endpoints#GenerativeAI#HuggingFace#LLMLearn how to deploy LLMs using Hugging Face Inference EndpointsRead more →
Published onJune 28, 2023Optimize & Deploy BERT on AWS inferentia2#Inferentia#HuggingFace#BERT#NLPLearn how to optimize and deploy BERT on AWS Inferentia2Read more →
Published onJune 20, 2023Securely deploy LLMs inside VPCs with Hugging Face and Amazon SageMaker#GenerativeAI#HuggingFace#SageMaker#LLMLearn how to deploy LLMs into VPCs from S3 with Amazon SageMaker using the new Hugging Face LLM Inference DLC.Read more →
Published onJune 7, 2023Deploy Falcon 7B & 40B on Amazon SageMaker#GenerativeAI#HuggingFace#SageMaker#LLMLearn how to deploy Falcon 40B to Amazon SageMaker using the new Hugging Face LLM Inference DLC.Read more →
Published onJune 6, 2023Fine-tune BERT for Text Classification on AWS Trainium#Trainium#HuggingFace#BERT#NLPLearn how to fine-tune Hugging Face Transformers using AWS Trainium.Read more →
Published onMay 31, 2023Introducing the Hugging Face LLM Inference Container for Amazon SageMaker#GenerativeAI#HuggingFace#SageMaker#LLMLearn how to deploy the open-source LLMs, like BLOOM to Amazon SageMaker for inference using the new Hugging Face LLM Inference Container.Read more →
Published onMay 23, 2023Generative AI for Document Understanding with Hugging Face and Amazon SageMaker#GenerativeAI#HuggingFace#SageMaker#DonutLearn how to fine-tune Donut-base a Generative AI model for document-understand/document-parsing using Hugging Face Transformers and Amazon SageMaker.Read more →
Published onMay 2, 2023How to scale LLM workloads to 20B+ with Amazon SageMaker using Hugging Face and PyTorch FSDP#Huggingface#GenerativeAI#GPT#SageMakerLearn how to fine-tune LLMs on multi-node setups using Amazon SageMaker and Hugging Face Transformers with PyTorch FSDPRead more →
Published onApril 25, 2023Setting up AWS Trainium for Hugging Face Transformers#AWS#HuggingFace#BERT#TrainiumLearn how to quickly set up an AWS Trainium using the Hugging Face Neuron Deep Learning AMI and fine-tune BERTRead more →