Azure Generative AI: The Complete Guide

The Azure generative AI stack, end to end, for engineers and architects: Azure AI Foundry as the front door, Azure OpenAI and the model catalog for models, Provisioned Throughput and Batch for the bill, plus the retrieval, agent, safety, cost and governance layers that turn a model into a product. A 30-part series that reads from first principles to production. Where it meets vendor-neutral ground it links to the Generative AI guide and the AWS Gen AI guide rather than repeating them.

Series in progress · 20 of 30 published
Phase 1 · Platform foundations
  1. 01What the Azure GenAI Stack Is, End to End
  2. 02The Azure AI Foundry Platform
  3. 03Azure OpenAI in Foundry Models
  4. 04The Model Catalog and Models-as-a-Service
  5. 05Azure OpenAI vs Foundry vs Azure ML
  6. 06Deployment Types: Standard, PTU and Batch
  7. 07ND-Series GPUs and Maia
  8. 08Regions, Quotas and Data Zones
  9. 09Private Link and VNet for Azure OpenAI
  10. 10Entra ID, Managed Identities and Encryption
Phase 2 · Calling models, RAG and agents
  1. 11Calling Models: REST, SDKs and the Responses API
  2. 12Azure AI Search and RAG
  3. 13Azure AI Foundry Agent Service
  4. 14Azure AI Content Safety
  5. 15Prompt Flow
  6. 16Fine-Tuning Azure OpenAI
  7. 17Distillation and Stored Completions
Phase 3 · Open models, training and multimodal
  1. 18Open Models on Azure ML
  2. 19Distributed Training on ND Clusters
  3. 20Data Prep, Grounding and Indexing
  4. 21Semantic Kernel, AutoGen and Agent Framework
  5. 22Microsoft Copilot Studio
  6. 23Evaluation and Observability in Foundry
  7. 24Multimodal: Vision, Audio, Image and Docs
Phase 4 · Operations, cost and governance
  1. 25Azure Monitor Observability
  2. 26Cost Governance and FinOps
  3. 27Responsible AI and the RAI Dashboard
  4. 28LLMOps and CI/CD on Azure
  5. 29Reference Architectures on Azure
  6. 30Azure GenAI vs the Field, the Verdict

Architect’s Toolkit

About the Author

Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.