Published onSeptember 20, 2023Fine-tune Falcon 180B with DeepSpeed ZeRO, LoRA & Flash Attention#GenerativeAI#HuggingFace#LLM#DeepspeedIn this example we will show how to fine-tune Falcon 180B using DeepSpeed, Hugging Face Transformers, LoRA with Flash Attention on a multi-GPU machine.Read more →
Published onFebruary 22, 2023Combine Amazon SageMaker and DeepSpeed to fine-tune FLAN-T5 XXL#T5#DeepSpeed#HuggingFace#SageMakerLearn how to fine-tune Google's FLAN-T5 XXL on Amazon SageMaker using DeepSpeed and Hugging Face Transformers.Read more →
Published onFebruary 16, 2023Fine-tune FLAN-T5 XL/XXL using DeepSpeed & Hugging Face Transformers#T5#DeepSpeed#HuggingFace#SummarizationLearn how to fine-tune Google's FLAN-T5 XXL using DeepSpeed & Hugging Face Transformers.Read more →
Published onNovember 8, 2022Accelerate Stable Diffusion inference with DeepSpeed-Inference on GPUs#Diffusion#DeepSpeed#HuggingFace#OptimizationLearn how to optimize Stable Diffusion for GPU inference with a 1-line of code using Hugging Face Diffusers and DeepSpeed.Read more →
Published onSeptember 13, 2022Accelerate GPT-J inference with DeepSpeed-Inference on GPUs#GPTJ#DeepSpeed#HuggingFace#OptimizationLearn how to optimize GPT-J for GPU inference with a 1-line of code using Hugging Face Transformers and DeepSpeed.Read more →
Published onAugust 16, 2022Accelerate BERT inference with DeepSpeed-Inference on GPUs#BERT#DeepSpeed#HuggingFace#OptimizationLearn how to optimize BERT for GPU inference with a 1-line of code using Hugging Face Transformers and DeepSpeed.Read more →