, ,

VCF 9 Reference Architecture: Sizing, Topology and Design Trade-offs (VCF 9 Series, Part 7)

The VCF 9 management domain topology, appliance sizing and the standard versus consolidated decision, plus the one appliance (VCF Automation) that quietly drives your whole BOM.

VCF 9 Series · Part 7 of 37

TL;DR · Key Takeaways

  • A simple deployment model is a minimum of 7 appliances. The HA model is a minimum of 13. HA is the production answer.
  • VCF Automation is a fixed 24 vCPU and 96 GB RAM appliance, times 3 in HA. It is the single biggest driver of management-cluster sizing.
  • Run NSX Manager as a 3-node cluster in production. Single-node is lab and PoC only.
  • Avi controllers default to a 3-node cluster. VCF 9.1 adds a supported single-node simple deployment.
  • Standard architecture (separate management and workload domains) is the validated model. Consolidated is for small or constrained environments.
Who this is for: Architects sizing a VCF 9 management domain and laying out the appliance topology.  Prerequisites: Familiarity with the fleet, instance and domain model and a target host BOM.

Reference architectures fail in one of two ways: too thin to survive a host failure, or so padded that the management overhead eats the budget. VCF 9 has one appliance in particular that decides which way your design tips, and most BOMs underweight it. Here is the topology, the sizing, and the trade-offs that actually move the number.

VCF 9 Reference Architecture: Topology & SizingOne instance: a required management domain plus workload domains, sized independently.Management DomainRuns the SDDC management plane only• 4 ESXi hosts minimum (vSAN)• vCenter + SDDC Manager• NSX mgmt + Edge cluster• VCF Operations + Fleet Mgmt• Avi controllers (optional)Sizing: do not run production here.Under-sizing the mgmt domain is the #1 design miss.VI / Workload Domain(s)Add per tenant, env, or hardware class• 3 hosts min (vSAN), 4 recommended• 2 hosts min with external storage• Own vCenter + NSX scope• Scale to 96 hosts/cluster• Separate lifecycle & capacitySplit by failure domain, not convenience.More domains = cleaner blast radius and LCM.
VCF 9 single-instance topology: a dedicated management domain plus independently sized workload domains.

The management domain topology

Management domain appliance inventory. Cluster: minimum 4 hosts on vSAN, NFS, or VMFS on FC.

ComponentSimpleHANotes
vCenter11
SDDC Manager11
Fleet Manager11Fleet services serve every instance
Operations Collector11
NSX Manager13clustered for HA
VCF Operations13clustered for HA
VCF Automation13clustered for HA
Base total713minimum appliance count
VCF Operations for Logs+3+3optional, its own 3-node cluster, on top of base
NSX Edge clusterday-Nday-Nadd when north-south / services are needed
Avi Controlleroptx3or single-node in 9.1

The simple deployment model is a minimum of 7 appliances: a single vCenter, SDDC Manager, a single NSX Manager, a single VCF Operations with Fleet Manager and Collector, and a single VCF Automation. The HA model is a minimum of 13: three NSX Managers, three VCF Operations, three VCF Automation, plus the single vCenter, SDDC Manager, Fleet Manager, and Collector. VCF Operations for Logs is an additional component, typically its own three-node cluster, so budget for it on top of the base 13. For production you run HA. The management cluster is a minimum of 4 hosts on vSAN, NFS, or VMFS on FC, sized as covered in the planning checklist.

Appliance sizing that matters

VCF Automation is the heavyweight. It is a fixed one-size appliance at 24 vCPU and 96 GB RAM, with no t-shirt sizing, and it should not be shrunk. In HA that is three of them. NSX Manager is selectable as Medium, Large, or Extra Large, deployed as a 3-node cluster for production or a single node for lab. VCF Operations sizes per node from Extra Small (2 vCPU, 8 GB, around 700 objects) up to Extra Large (24 vCPU, 128 GB, around 100,000 objects), and HA halves effective object capacity because every object is replicated. vCenter follows the familiar Tiny through Extra Large range and the Installer defaults it to a Large-class deployment. The vSAN cluster that backs all of this should be ESA, as argued in Part 6.

The HA appliance footprint, totalled

Totalled with production-realistic sizes (vCenter Large, NSX Manager and VCF Operations at Medium, Operations for Logs at Small), an HA management domain runs about 158 vCPU and 570 GB of appliance RAM, and VCF Automation alone is roughly half of that RAM. Per-appliance figures come from the VCF 9 sizing guidance; confirm them against the current docs for your release.

ApplianceHA countvCPU eachRAM eachRAM subtotal
vCenter (Large)11639 GB39 GB
SDDC Manager1416 GB16 GB
Fleet Manager1412 GB12 GB
Operations Collector1823 GB23 GB
NSX Manager (Medium)3624 GB72 GB
VCF Operations (Medium)3832 GB96 GB
VCF Automation32496 GB288 GB
Operations for Logs (Small, additional)348 GB24 GB
Total (incl. Logs)16158n/a~570 GB
HA management-domain RAM footprint (~570 GB)VCF Automation alone is about half the total appliance RAMVCF Automation (x3)288 GBVCF Operations (x3)96 GBNSX Manager (x3)72 GBvCenter (Large)39 GBOperations for Logs (x3)24 GBOperations Collector23 GBSDDC Manager16 GBFleet Manager12 GBDefer VCF Automation if you will not consume self-service in year one, but still reserve the host RAM.
Appliance RAM by component in an HA management domain; VCF Automation is the BOM-buster.

Standard vs consolidated

Standard architecture puts management and workload domains on separate clusters and hosts, each workload domain with its own vCenter and autonomous lifecycle. That is the validated, recommended model and the one to default to. Consolidated collapses management and workload into one cluster with resource pools for isolation, and it is appropriate only for small, PoC, or resource-constrained environments. A note of honesty: the consolidated and standard labels carry over partly from VCF 5.x community framing, and VCF 9 docs lean on the domain model itself, so confirm the exact terminology against the current design guide before you put it in a customer deliverable. Scale maximums inherit from vSphere 9 (96 hosts per cluster, up to 2,500 hosts per vCenter), and you should always confirm against configmax for your release.

VCF Operations node sizes

VCF Operations is the one component where you genuinely choose a size against a scale target, so it is worth having the numbers in front of you. Sizes are per node, and an HA cluster halves the effective object capacity because every object is replicated. A cluster scales to 16 Large nodes or 12 Extra Large nodes.

SizevCPURAMObjects (per node)
Extra Small28 GB~700
Small416 GB~10,000
Medium832 GB~30,000
Large1648 GB~44,000
Extra Large24128 GB~100,000
VCF Operations: objects per node by sizeHA halves effective capacity, since every object is replicatedExtra Small (2 vCPU, 8 GB)~700 obj/nodeSmall (4 vCPU, 16 GB)~10,000 obj/nodeMedium (8 vCPU, 32 GB)~30,000 obj/nodeLarge (16 vCPU, 48 GB)~44,000 obj/nodeExtra Large (24 vCPU, 128 GB)~100,000 obj/nodeA cluster scales to 16 Large nodes or 12 Extra Large nodes; size against your real object count.
Pick the Operations node size against your scale target, then halve it for HA.

Edge and Avi: the day-N footprint

Two components sit outside the base appliance count but belong in your capacity plan from the start. The NSX Edge cluster is optional and deployed as a day-N operation, but you need it the moment you want centralized north-south services or the vSphere Supervisor, so reserve hosts and uplink VLANs for it rather than discovering the requirement later. Avi controllers default to a three-node cluster for HA, with VCF 9.1 adding a supported single-node simple deployment in the VCF Operations UI. VCF places the controllers on the correct management or edge segment automatically, but the three controllers are still real appliances competing for management-domain RAM, so fold them into the same sizing exercise as the rest of the stack. Whether you even need Avi depends on the load-balancing decision in Part 11.

Scale maximums and where to confirm them

VCF 9 inherits its scale ceilings from vSphere 9: up to 96 hosts per cluster and up to 2,500 hosts per vCenter, with no VCF-specific tightening reported. Those are ceilings, not targets, and the practical limit on a management domain is usually RAM for the appliances long before you reach a host-count maximum. Always confirm the exact numbers for your release at configmax.broadcom.com, because maximums shift between point releases and a design that quotes last year’s figure is a design that ages badly. If you are planning stretched or multi-availability-zone clusters, the host-count and witness requirements change again, and that belongs in a dedicated design pass rather than the standard single-site topology here.

My take

The real day-one sizing trap is VCF Automation. Three HA nodes at 24 vCPU and 96 GB each is 72 vCPU and 288 GB of management overhead before a single tenant workload runs, and stacked with three NSX, three Operations, and the Logs appliances, an HA management domain consumes the better part of four hosts worth of RAM in appliances alone. My recommendation: if you are not actually consuming self-service automation in year one, deploy the management domain HA without VCF Automation (the Installer lets you defer it or point at an existing instance) and add it later. But still spec the host RAM as if it is there, because retrofitting 288 GB of headroom into an already-built vSAN cluster is far more painful than buying it up front. The docs tell you to size for it from day one. They do not tell you it is the line item most likely to blow your management-cluster BOM.

What’s Next

Build your management-cluster BOM from the appliance footprint up, not from a host count down, and decide deliberately whether VCF Automation lands in year one or year two. With the topology set, the next step is the management domain bring-up. Are you sizing for VCF Automation now, or deferring it and reserving the RAM?

References

VCF 9 Series · Part 7 of 37
« Previous: Part 6  |  VCF 9 Complete Guide  |  Next: Part 8 »

About The Author


Discover more from Journal of Intelligent Infrastructure – By Dr Pranay Jha

Subscribe to get the latest posts sent to your email.

Leave a Reply

Your email address will not be published. Required fields are marked *

Architect’s Toolkit

About the Author

Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.

VCF 9 Series

Discover more from Journal of Intelligent Infrastructure - By Dr Pranay Jha

Subscribe now to keep reading and get access to the full archive.

Continue reading