Tag: Vertex AI
-
Google Cloud Generative AI vs the Field, the Verdict (Google Cloud Gen AI Series, Part 30)
The closing scorecard on Google Cloud generative AI. Where Vertex AI and Gemini win, where they fall short, and how I would choose against AWS Bedrock and Azure AI Foundry in 2026.
-
Reference Architectures on Google Cloud, from Chatbot to Batch (Google Cloud Gen AI Series, Part 29)
Most generative AI on Google Cloud reduces to four shapes: a direct call, RAG, an agent, and batch. Here is how each maps to managed services, what it costs, and which one to reach for first.
-
Vertex AI Pipelines for LLMOps, from Notebook to Nightly Retrain (Google Cloud Gen AI Series, Part 28)
How I turn a Gemini tuning notebook into a Vertex AI pipeline that reruns nightly, gates on evals, registers versions, and does not quietly ship a worse model.
-
Vertex AI Cost Governance and FinOps (Google Cloud Gen AI Series, Part 26)
Read a Vertex AI bill line by line, then cut it with model tiering, context caching, Batch mode, and provisioned throughput judged against a real break-even. With budgets, billing export, and label-based attribution.
-
Vertex AI Observability and Tracing, from Dashboard to Span (Google Cloud Gen AI Series, Part 25)
A green status code on an eight second request tells you nothing. Here is how Cloud Monitoring, Cloud Trace, and Cloud Logging on Vertex AI tell you which call was slow, what it cost, and what to never log.
-
Vertex AI Gen AI Evaluation Service, Pointwise to Trajectory (Google Cloud Gen AI Series, Part 23)
The Vertex AI Gen AI evaluation service turns a two-example spot check into a number you can gate a release on. How pointwise, pairwise, rubric, and trajectory metrics work, and how to validate the autorater judge before you trust it.
-
Multi-Agent Systems on Vertex AI with ADK and Agent Engine (Google Cloud Gen AI Series, Part 21)
One big agent with twenty tools rots fast. Here is how to split it into a coordinator and typed sub-agents with the ADK, choose deterministic versus LLM-driven flows, connect across boundaries with A2A, and deploy to Vertex AI Agent Engine.
-
Gemma Open Models on Vertex AI, from Model Garden to Endpoint (Google Cloud Gen AI Series, Part 18)
When a managed Gemini bill stops making sense, Gemma is the open model you host yourself on Vertex AI. Here is the 2026 lineup, the deploy path through Model Garden, and the volume where self-hosting actually pays.
-
Distilling Gemini on Vertex AI, from Teacher to Student Model (Google Cloud Gen AI Series, Part 17)
Distillation trains a small Gemini student to copy a large teacher, so the teacher writes the labels and you serve the result at Flash prices. When it pays, what it costs, and where it fails.
-
Fine-Tuning Gemini with Supervised Tuning on Vertex AI (Google Cloud Gen AI Series, Part 16)
Supervised fine-tuning on Vertex AI adjusts Gemini to your task with a few hundred labelled examples, and because it uses LoRA the tuned model costs the same to run as the base. Here is when to tune, how to build the dataset, the knobs that matter, and what it costs.
-
Grounding Gemini with Google Search and Your Own Data (Google Cloud Gen AI Series, Part 15)
How to ground Gemini on Vertex AI against the live web and your own Vertex AI Search data store, read the grounding metadata, render citations correctly, and size what it costs.
Architect’s Toolkit
PJ’s Tools
VMware Cloud Foundation
- VCF Documentation
- VCF 9 Planning & Preparation Workbook
- VCF Bill of Materials (BoM)
- VMware Compatibility Guide
- VMware Interoperability Matrix
- VMware Configuration Maximums
- VMware Ports & Protocols
- VMware Hands-on Labs
- RVTools Download
Nutanix
AI & Cloud-Native Platform
- NVIDIA Build (Model Catalog)
- NVIDIA AI Enterprise Reference Architecture
- NVIDIA NIM Performance Benchmarking
- NVIDIA NGC Catalog
- NeMo Microservices Helm Chart
- Helm Charts Repository
- Hugging Face Models
Architecture & Design
About the Author
Dr Pranay Jha
Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.
You May Have Missed
DrJha