Published onSeptember 20, 2023Fine-tune Falcon 180B with DeepSpeed ZeRO, LoRA & Flash Attention#GenerativeAI#HuggingFace#LLM#DeepspeedIn this example we will show how to fine-tune Falcon 180B using DeepSpeed, Hugging Face Transformers, LoRA with Flash Attention on a multi-GPU machine.Read more →
Published onSeptember 12, 2023Fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker#GenerativeAI#HuggingFace#LLM#SageMakerLearn how to fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker.Read more →
Published onSeptember 7, 2023Deploy Falcon 180B on Amazon SageMaker#GenerativeAI#HuggingFace#LLM#SageMakerLearn how to deploy Falcon 180B to Amazon SageMaker and how to create a chatbot with streaming inference.Read more →
Published onAugust 31, 2023Optimize open LLMs using GPTQ and Hugging Face Optimum#GenerativeAI#HuggingFace#LLM#OptimizationLearn how to quantize Llama 2 7B with GPTQ to use 4x less memory.Read more →
Published onAugust 15, 2023LLMOps: Deploy Open LLMs using Infrastructure as Code with AWS CDK#GenerativeAI#HuggingFace#LLMOps#SageMakerLearn how to use Infrastructure as Code with (AWS CDK)] to deploy and manage Llama 2Read more →
Published onAugust 7, 2023Deploy Llama 2 7B/13B/70B on Amazon SageMaker#GenerativeAI#HuggingFace#SageMaker#LLMLearn how to deploy Llama 2 models (7B - 70B) to Amazon SageMaker using the Hugging Face LLM Inference DLC.Read more →
Published onAugust 3, 2023Introducing EasyLLM - streamline open LLMs#GenerativeAI#OpenSource#LLMEasyLLM is an open-source project that provides helpful tools and methods for working with large language models (LLMs).Read more →
Published onJuly 26, 2023Extended Guide: Instruction-tune Llama 2#GenerativeAI#HuggingFace#LLM#LlamaThis blog post is an extended guide on instruction-tuning Llama 2 from Meta AIRead more →
Published onJuly 21, 2023LLaMA 2 - Every Resource you need#GenerativeAI#HuggingFace#LLM#LLaMAAll Resources for LLaMA 2, How to test, train, and deploy it.Read more →
Published onJuly 18, 2023Fine-tune LLaMA 2 (7-70B) on Amazon SageMaker#LLAMA#HuggingFace#LLM#SageMakerLearn how to train LLaMa 2 using QLoRA Hugging Face Transformers on Amazon SageMakerRead more →
