-
Do you know why we need security at every layer of an AI system?
Do you know why we need security at every layer of an AI system? Most people say: “To protect data.” That’s true… but it’s only half the story. Let’s take a real example 👇 An LLM like Llama-3.1-70B, when deployed using NVIDIA NIM, is not just a model, it also includes: Now think about this:…
-
Preparing for NVIDIA Certified Professional – AI Infrastructure? Here’s What Actually Happened to Me
“I’m not from AI… can I even do this?” When I first decided to prepare for the NVIDIA Certified Professional – AI Infrastructure, I had a very honest thought: “I’m not from a pure AI background… how am I going to understand all this?” Yes, I did have some exposure to AI/ML during my PhD.…
-
What happens to my data once it is uploaded, something available that i can use locally instead of exposing my data to internet?
Same question as my last post as raised by an audience during the academic webinar, it may sound like a common or even a silly question, but it had a deeper meaning. Because this concern is not just limited to academic professionals but also applies equally to enterprises when it comes to the security of…
-
Why I cannot use my laptop to use AI rather going outside the premises?
This post is continuous to the question someone asked in academic webinar, 𝐰𝐡𝐲 𝐢 𝐜𝐚𝐧𝐧𝐨𝐭 𝐮𝐬𝐞 𝐦𝐲 𝐥𝐚𝐩𝐭𝐨𝐩 𝐭𝐨 𝐤𝐞𝐞𝐩 𝐚𝐥𝐥 𝐋𝐋𝐌𝐬, 𝐚𝐬𝐤 𝐪𝐮𝐞𝐫𝐲, 𝐭𝐫𝐚𝐢𝐧𝐢𝐧𝐠, 𝐢𝐧𝐟𝐞𝐫𝐞𝐧𝐜𝐢𝐧𝐠, 𝐞𝐭𝐜 𝐫𝐚𝐭𝐡𝐞𝐫 𝐠𝐨𝐢𝐧𝐠 𝐨𝐮𝐭𝐬𝐢𝐝𝐞 𝐭𝐡𝐞 𝐩𝐫𝐞𝐦𝐢𝐬𝐞𝐬! Because, It’s not just one thing.There are 3 distinct layers, each with very different costs, infrastructure, and challenges 👇 1. 𝐌𝐨𝐝𝐞𝐥 𝐓𝐫𝐚𝐢𝐧𝐢𝐧𝐠 This…
-
My VCF 9 Architect (2V0-13.25) Exam Experience
Hey, thanks for visiting here. First of all, I would like to wish you all the best if you are planning to attempt or currently preparing for the VMware Cloud Foundation (VCF) 9 Architect exam (2V0-13.25). Though I am not the first one sharing this kind of experience, I still thought to write this because…
-
Case Scenario: Designing VMware Cloud Foundation Under Network Constraint – What’s your thoughts as Solution Architect?
Problem Statement A leading financial institution in Southeast Asia is undergoing a large-scale infrastructure transformation to modernize its private cloud platform and improve service delivery for mission-critical banking applications. The organization has been a long-time user of VMware technologies and currently operates a highly virtualized environment supporting thousands of virtual machines across core banking, digital…
-
SRE Concepts You Must Need to Know – SLI, SLO, SLA, Error Budget, Golden Signals
In modern Site Reliability Engineering (SRE), metrics are more than just numbers — they represent trust between systems, users, and teams.Whether you manage a global SaaS platform or an on-prem VMware private cloud, understanding SLI, SLO, SLA, and Error Budgets is the foundation for measuring reliability in a scientific, data-driven way. In this post, I’ll…
-
VMware Private AI Foundation in VCF 9: Everything You Need to Know (FAQs)
Category Question Answer Deployment & Infrastructure What kind of infrastructure is required to run VMware Private AI on-premises? VMware vSphere / VCF 9 clusters with NVIDIA GPUs (Blackwell GPUs recommended for high-performance AI workloads). Deployment & Infrastructure Can it run on existing VMware vSphere clusters or do we need new hardware? Yes, it integrates with…
-
How VMware Private AI Foundation with NVIDIA in VCF 9 is Changing Enterprise AI
A few months ago, I was working with a customer who was running critical workloads on VMware on-premises. They were already using AWS internally for a GenAI chatbot, but now they wanted to expand AI use cases to predict and remediate infrastructure issues, including agentic AI solutions. The challenge? They didn’t want to rely on…
-
What is VMware Data Services Manager (DSM) in VCF 9?
In simple terms, DSM is like a self-service database platform for your data center. Developers can request databases, IT stays in control, and everything runs on VMware Cloud Foundation 9. You can spin up PostgreSQL, MySQL, MariaDB, and even SQL Server (in tech preview), all from a single interface. Imagine being able to give your…
-
Zero Downtime for AI Workloads: How VCF 9 Transforms vMotion for AI/ML Environments
Imagine this, your GPUs are crunching away at massive models, everything looks good… and then the dreaded email arrives from IT: “We received a critical patch for ESXi and need to patch the host tonight. Please stop your workload, as there will be slight downtime for heavy workload based VMs during this activity.” Stopping wasn’t…
Architect’s Toolkit
PJ’s Tools
VMware Cloud Foundation
- VCF Documentation
- VCF 9 Planning & Preparation Workbook
- VCF Bill of Materials (BoM)
- VMware Compatibility Guide
- VMware Interoperability Matrix
- VMware Configuration Maximums
- VMware Ports & Protocols
- VMware Hands-on Labs
- RVTools Download
Nutanix
AI & Cloud-Native Platform
- NVIDIA Build (Model Catalog)
- NVIDIA AI Enterprise Reference Architecture
- NVIDIA NIM Performance Benchmarking
- NVIDIA NGC Catalog
- NeMo Microservices Helm Chart
- Helm Charts Repository
- Hugging Face Models
Architecture & Design
About the Author
Dr Pranay Jha
Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.
Recommendations & Endorsements
Pranay has very deep technical knowledge and exceptional capabilities. He has strong ability to well-manage complex situations and deliver the customer expectations with high standards of satisfaction. We worked together in one of most complex migration projects and Pranay delivered flawlessly.
Pranay was my VMware Architect on one of our financial accounts at IBM. He was instrumental in documenting and recommending our reference architecture. As a Chief Architect, you are only as good as your team that supports you. Pranay was top notch.
Pranay is proactive, result oriented, responsible and technically sound. Always ready to put all his energy to get the job done. Exceptional troubleshooting skills in Windows Server, virtualization and VMware — a great asset to any company.
Pranay is one of the most talented and dedicated persons I have ever worked with. His vast knowledge from different domains enables him to discuss and help on almost every topic in IT. Needless to say, he is expert of experts in VMware.
DrJha