Deploy open LLMs with Terraform and Amazon SageMaker
August 5, 2024 — HuggingFace, SageMaker, Llama 3, Terraform
Index
2024 June
Evaluating Open LLMs with MixEval: The Closest Benchmark to LMSYS Chatbot Arena
June 28, 2024 — HuggingFace, LLMs, Evaluation
Train and Deploy open Embedding Models on Amazon SageMaker
June 25, 2024 — HuggingFace, SageMaker, Embeddings
Deploy Mixtral 8x7B on AWS Inferentia2 with Hugging Face Optimum
June 18, 2024 — HuggingFace, SageMaker, Inferentia2, LLM
Fine-tune Llama 3 with PyTorch FSDP and Q-Lora on Amazon SageMaker
June 11, 2024 — HuggingFace, SageMaker, Llama 3
Fine-tune Embedding models for Retrieval Augmented Generation (RAG)
June 4, 2024 — HuggingFace, Embedding, Generative AI, Fine-tuning
2024 May
Understanding the Cost of Generative AI Models in Production
May 27, 2024 — Generative AI, Cost
Deploy Llama 3 70B on AWS Inferentia2 with Hugging Face Optimum
May 23, 2024 — HuggingFace, SageMaker, Llama 3
Deploy open LLMs with vLLM on Hugging Face Inference Endpoints
May 2, 2024 — HuggingFace, LLM, Llama 3
2024 April
Efficiently fine-tune Llama 3 with PyTorch FSDP and Q-Lora
April 22, 2024 — HuggingFace, LLM, Training, GenerativeAI
Deploy Llama 3 on Amazon SageMaker
April 18, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
Accelerate Mixtral 8x7B with Speculative Decoding and Quantization on Amazon SageMaker
April 2, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI