logoPhilschmid

Index

2024 May

Deploy Llama 3 70B on AWS Inferentia2 with Hugging Face Optimum

May 23, 2024 — HuggingFace, SageMaker, Llama 3

Deploy open LLMs with vLLM on Hugging Face Inference Endpoints

May 2, 2024 — HuggingFace, LLM, Llama 3

2024 April

Efficiently fine-tune Llama 3 with PyTorch FSDP and Q-Lora

April 22, 2024 — HuggingFace, LLM, Training, GenerativeAI

Deploy Llama 3 on Amazon SageMaker

April 18, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI

Accelerate Mixtral 8x7B with Speculative Decoding and Quantization on Amazon SageMaker

April 2, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI

2024 March

Deploy Llama 2 70B on AWS Inferentia2 with Hugging Face Optimum

March 26, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI

Fine-Tune & Evaluate LLMs in 2024 with Amazon SageMaker

March 12, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI

Evaluate LLMs with Hugging Face Lighteval on Amazon SageMaker

March 5, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI

How to fine-tune Google Gemma with ChatML and Hugging Face TRL

March 1, 2024 — HuggingFace, LLM, RLHF, GenerativeAI

2024 January

RLHF in 2024 with DPO & Hugging Face

January 23, 2024 — HuggingFace, LLM, RLHF, GenerativeAI

How to Fine-Tune LLMs in 2024 with Hugging Face

January 23, 2024 — HuggingFace, LLM, Opensource, GenerativeAI

Scale LLM Inference on Amazon SageMaker with Multi-Replica Endpoints

January 11, 2024 — LLAMA, HuggingFace, LLM, SageMaker

2023 December

Fine-tune Llama 7B on AWS Trainium

December 21, 2023 — GenerativeAI, HuggingFace, LLM, AWS

Programmatically manage 🤗 Inference Endpoints

December 20, 2023 — GenerativeAI, HuggingFace, LLM, IaC

Deploy Mixtral 8x7B on Amazon SageMaker

December 12, 2023 — Mistral, HuggingFace, LLM, SageMaker