TL;DR Llama 4, the first multimodal models in the Llama family featuring a Mixture-of-Experts (MoE) architecture, is now available on Vertex AI! You can deploy Llama 4 Scout (with up to 10M token context model) and Llama 4 Maverick on Vertex AI with ...

TLDR; Deploy open models on Vertex AI in just THREE lines of code! The new Vertex AI Model Garden CLI and SDK, powered by the Deploy API, offers a model-centric interface, providing a consistent and fluid deployment experience for your open models on...

Building and scaling your own AI agent can seem complex, but it doesn't have to be! HuggingFace’s smolagent library provides a lightweight framework to build powerful agents. Vertex AI addresses deployment and management complexities for AI agents th...

Introduction Are you struggling to customize open models deployment on Vertex AI using Hugging Face Deep Learning Containers? Do you need precise control over your inference pipeline? Custom handlers are the solution. This blog post provides a practi...

Are you struggling to serve multiple LoRA adapters on Vertex AI? This blog post provides a practical example of how to deploy a Gemma 2 model with multiple LoRA adapters on Vertex AI using custom handlers to enable SQL and code generation tasks. Intr...