Dr. Pranay Jha

VMware • Cloud • AI • Enterprise Architecture

FORMERLY
VMware Insight & Cloud Pathshala
What began over a decade ago as a passion for sharing knowledge has evolved into a unified platform for Enterprise AI, VMware, Cloud Architecture, Research, and Modern Infrastructure.
,

NSX in VCF 9 Explained: Transit Gateways, VPCs and the Distributed Firewall (VCF 9 Series, Part 10)

NSX in VCF 9 keeps Tier-0 and Tier-1 but puts a cloud-style VPC model in front: NSX projects, one Transit Gateway each, distributed routing with no Edge VMs, and the DFW.

VCF 9 Series · Part 10 of 36

TL;DR · Key Takeaways

  • NSX is no longer a bolt-on. The networking kernel modules ship inside ESX and the VCF stack lifecycle-manages NSX.
  • Two object models now sit side by side: Segment Networking (Tier-0, Tier-1, segments) and VPC Networking (projects, VPCs, subnets).
  • An NSX project owns exactly one Transit Gateway, which interconnects the VPCs in that project and provides their external path.
  • A distributed Transit Gateway routes on the ESX hosts straight to a VLAN, with no NSX Edge VMs. Centralized routes via a Tier-0.
  • The Distributed Firewall still enforces east-west policy per vNIC. Verify bare-metal and L2-bridging support against the NSX 9 release notes before you upgrade.

Myth: VCF 9 networking is NSX-T 4.x with a coat of paint. Reality: the Tier-0 and Tier-1 constructs are still there, but VCF 9 puts a public-cloud-style consumption layer in front of them, and if you keep building the old way you pay for capability you never use. The split between the two models is the single thing to get straight before you design anything.

NSX in VCF 9: Logical TopologyNorth-south through the Tier-0 / transit gateway; east-west policy at the VPC and DFW.Physical / Provider edgeBGP uplinks to the fabricTier-0 gateway / Transit Gatewaycentralized north-south routing & servicesVPCs (self-service tenancy)each VPC: own subnets, NAT, and routingSegments + Distributed Firewall (DFW)workloads attach to segments; DFW enforces east-west micro-segmentation in the hypervisor
NSX in VCF 9: Tier-0/transit gateway for north-south, VPCs for tenancy, segments plus DFW for east-west.

NSX is no longer a bolt-on

In earlier releases you staged NSX, pushed VIBs to the hosts, and stitched it into vCenter as a separate product. VCF 9 collapses that. The virtual networking kernel modules ship inside ESX, so a new workload domain comes up network-ready without a separate NSX install pass, and NSX lifecycle (certificates, credentials, patches) is handled by the VCF stack with upgrades aligned to the vSphere cycle. Fewer manual steps, fewer version-mismatch incidents, one console to operate. This is the layer you stood up during the VI workload domain deployment in Part 9.

In Practice

VCF 9 lets you run a single NSX Manager instead of the three-node cluster. Treat that as a lab and edge-site convenience, not a production default. A single Manager is a single management-plane failure domain, and rebuilding it under pressure is not where you want to be. For any domain carrying real workloads, keep the three-node cluster.

Two object models: Segment and VPC

VCF 9 exposes two networking object models, and the UI makes the split explicit:

  • Segment Networking is the world NSX-T admins already know: Tier-0 gateways for north-south routing to the physical fabric, Tier-1 gateways, and overlay or VLAN segments you attach VMs to. The infrastructure team designs and owns this plumbing.
  • VPC Networking is the cloud-style consumption layer. It introduces the NSX project as a tenancy boundary, and inside a project, app and platform teams get isolated Virtual Private Clouds with their own subnets, NAT, firewall rules, and load balancing, self-service from vCenter or VCF Automation.

The mental shift is that you stop handing consumers Tier-1s and segments. You hand them a VPC. If the underlay and overlay design is not settled yet, that work sits upstream of all of this, and the network design mistakes from Part 5 are worth a read before you commit a topology.

Two object models, side by sideStop handing consumers Tier-1s and segments; hand them a VPCSegment Networking (infra-owned)Tier-0 gateway (north-south)Tier-1 gatewaysOverlay / VLAN segmentsYou design and own the plumbingVPC Networking (self-service)NSX project (tenancy boundary)Virtual Private Clouds (VPCs)Subnets, NAT, firewall, LBSelf-service via vCenter / Automation
Infrastructure designs Segment Networking once; consumers self-serve VPCs on top.

The Transit Gateway, and the project that owns it

The new connectivity construct is the Transit Gateway, a routing hub. Here is the detail people miss: an NSX project has exactly one Transit Gateway, and that gateway interconnects all the VPCs provisioned in the project and provides their path to the outside. You do not attach each VPC to a Tier-0 by hand anymore. The Transit Gateway is the hub, and it comes in two forms that route very differently.

  • Centralized Transit Gateway reaches the physical network through an upstream Tier-0 gateway running on NSX Edge nodes. This is the model closest to classic designs and the one you want when you need advanced or stateful north-south services at the edge.
  • Distributed Transit Gateway routes on the ESX hosts and connects directly to the physical network over a VLAN, with no NSX Edge VMs in the path. Fewer hops, higher throughput, and no Edge cluster to size.

The distributed model is the genuinely new idea. For years, north-south VPC connectivity meant deploying and sizing Edge VMs, and that was a recurring capacity-planning chore and a frequent bottleneck. In VCF 9 you can skip them for many distributed patterns and let the hosts route. The catch: services that need a centralized enforcement point still pull you back to the Tier-0 path, so the choice is about what services the workloads actually need, not about which one is newer.

DimensionCentralized TGWDistributed TGW
External pathVia upstream Tier-0 gatewayDirect to a VLAN from the hosts
NSX Edge nodesRequiredNot required
Data pathHosts to Edge to fabricHosts straight to fabric
Best whenYou need stateful or advanced edge servicesYou want throughput and a thin footprint
Trade-offEdge cluster to deploy, size, and patchEdge-only services not available on this path

Inside a VPC: the VPC gateway and the DFW

Each VPC is handed a VPC gateway automatically, and that gateway routes between the subnets inside the same VPC. East-west traffic between those subnets is allowed unless you restrict it, and the thing doing the restricting is the same crown jewel NSX always had: the Distributed Firewall. The DFW enforces rules at each VM virtual NIC, inside the hypervisor, so traffic between two VMs on the same host is inspected without hairpinning to a physical appliance. You write policy against dynamic groups (by tag, name, or OS) rather than IP addresses, so the rule follows the workload as it vMotions. That is the part to design well, because group-based policy is what makes microsegmentation survive a moving fleet.

NSX Project: prod-project
  • Transit Gateway (one per project): centralized via a Tier-0 on the Edge, or distributed direct to VLAN.
  • VPC: app-prod-vpc (the VPC gateway routes between its own subnets)
    • subnet web 10.40.1.0/24 (tag tier-web)
    • subnet app 10.40.2.0/24 (tag tier-app)
    • subnet db 10.40.3.0/24 (tag tier-db)
  • VPC: shared-svc-vpc

Distributed Firewall (per vNIC, group-based, follows vMotion)

ActionSourceDestinationPort
allowanytier-webtcp 443
allowtier-webtier-apptcp 8080
allowtier-apptier-dbtcp 5432
denyanyanyany (default)

The bare-metal and L2 caveat

One caution for NSX-T veterans before you upgrade. The way NSX 9 handles physical, bare-metal servers and overlay-backed L2 bridging has changed across the 9.x line, and some attachment patterns that worked under NSX-T 3.x and 4.x do not carry forward unchanged. The Distributed Firewall still protects physical servers, but if your current design bridges bare-metal hosts onto overlay segments or leans on NSX L2 bridging, do not assume it survives the move. Check your exact pattern against the NSX 9 release notes and the VCF 9 networking documentation, and plan that workload deliberately rather than discovering the gap mid-cutover.

Lifecycle and live patching

Because the networking modules live inside ESX, NSX upgrades stop being a separate project. They align with vSphere lifecycle, and vLCM live patching applies many fixes without the rolling host evacuations that NSX-T upgrades used to demand. That removes a real class of incident: the version drift where NSX and vCenter fall out of step and a workflow breaks, because the VCF stack now manages the pairing. You give up some independent-upgrade flexibility in exchange. For most shops that is a good trade, because the flexibility mostly bought you the freedom to create the drift in the first place.

Who owns what

The payoff of the VPC model is that the infrastructure team stops being a ticket queue for subnets. Once the Segment Networking plumbing is designed and the project and its Transit Gateway are in place, a platform or app team can request a VPC with its own subnets, NAT, firewall rules, and load balancing without touching Tier-0 or the physical fabric. Hold the boundary explicitly: infrastructure owns the underlay, the overlay design, the project, and the Transit Gateway; consumers own what lives inside their VPC. The most common failure here is not technical. It is an infrastructure team that keeps doing VPC-level work out of habit and never realizes the self-service benefit it just paid for.

Who owns whatHold the boundary, or you never realize the self-service benefit you paid forInfrastructure teamUnderlayOverlay designNSX projectTransit GatewayConsumers (inside the VPC)SubnetsNATFirewall rulesLoad balancing
Infrastructure owns the plumbing and the project; consumers own everything inside their VPC.

The Bottom Line

NSX in VCF 9 rewards you for not rebuilding your old topology out of muscle memory. Design the Segment Networking layer once, define a project per tenancy boundary, and expose VPCs so consumers self-serve. Reach for a distributed Transit Gateway unless a workload genuinely needs Edge-hosted services, keep the three-node Manager cluster in production, and verify the bare-metal and L2 story against the release notes before any upgrade. Which part of your NSX design are you most likely to over-engineer out of habit, the Edge cluster or the Tier-1 sprawl? That is usually the first thing to simplify. Load balancing inside this model is its own decision, covered in Part 11.

References

VCF 9 Series · Part 10 of 36
« Previous: Part 9  |  VCF 9 Complete Guide  |  Next: Part 11 »

About The Author


Discover more from Dr. Pranay Jha

Subscribe to get the latest posts sent to your email.

Leave a Reply

Your email address will not be published. Required fields are marked *

Architect’s Toolkit

About the Author

Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.

VCF 9 Series

Discover more from Dr. Pranay Jha

Subscribe now to keep reading and get access to the full archive.

Continue reading