Llm

In this example we will show how to fine-tune Falcon 180B using DeepSpeed, Hugging Face Transformers, LoRA with Flash Attention on a multi-GPU machine.

Learn how to fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker.

Learn how to deploy Falcon 180B to Amazon SageMaker and how to create a chatbot with streaming inference.

Learn how to quantize Llama 2 7B with GPTQ to use 4x less memory.

Learn how to deploy Llama 2 models (7B - 70B) to Amazon SageMaker using the Hugging Face LLM Inference DLC.

EasyLLM is an open-source project that provides helpful tools and methods for working with large language models (LLMs).

This blog post is an extended guide on instruction-tuning Llama 2 from Meta AI

All Resources for LLaMA 2, How to test, train, and deploy it.

Learn how to train LLaMa 2 using QLoRA Hugging Face Transformers on Amazon SageMaker

Learn how to train LLMs using QLoRA on Amazon SageMaker

Learn how to deploy LLMs using Hugging Face Inference Endpoints

Learn how to deploy LLMs into VPCs from S3 with Amazon SageMaker using the new Hugging Face LLM Inference DLC.

Learn how to deploy Falcon 40B to Amazon SageMaker using the new Hugging Face LLM Inference DLC.

Learn how to deploy the open-source LLMs, like BLOOM to Amazon SageMaker for inference using the new Hugging Face LLM Inference Container.

IGEL (Instruction-based German Language Model) is an LLM designed for German language understanding tasks, including sentiment analysis, language translation, and question answering.