Accelerate Mixtral 8x7B with Speculative Decoding and Quantization on Amazon SageMaker
April 2, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
Index
2024 March
Deploy Llama 2 70B on AWS Inferentia2 with Hugging Face Optimum
March 26, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
Fine-Tune & Evaluate LLMs in 2024 with Amazon SageMaker
March 12, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
Evaluate LLMs with Hugging Face Lighteval on Amazon SageMaker
March 5, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
How to fine-tune Google Gemma with ChatML and Hugging Face TRL
March 1, 2024 — HuggingFace, LLM, RLHF, GenerativeAI
2024 January
RLHF in 2024 with DPO & Hugging Face
January 23, 2024 — HuggingFace, LLM, RLHF, GenerativeAI
How to Fine-Tune LLMs in 2024 with Hugging Face
January 23, 2024 — HuggingFace, LLM, Opensource, GenerativeAI
Scale LLM Inference on Amazon SageMaker with Multi-Replica Endpoints
January 11, 2024 — LLAMA, HuggingFace, LLM, SageMaker
2023 December
2023 November
Deploy Embedding Models on AWS inferentia2 with Amazon SageMaker
November 21, 2023 — GenerativeAI, Embeddings, SageMaker, Inferentia
Deploy Llama 2 7B on AWS inferentia2 with Amazon SageMaker
November 14, 2023 — GenerativeAI, Llama, SageMaker, Inferentia
Deploy Stable Diffusion XL on AWS inferentia2 with Amazon SageMaker
November 7, 2023 — GenerativeAI, SDXL, SageMaker, Inferentia
Amazon Bedrock: How good (bad) is Titan Embeddings?
November 3, 2023 — GenerativeAI, LLM, Evaluation