, ,

How to Configure NSX Federation Across VCF 9.1 Instances (VCF 9.1 Day-2 Operations Step by Step Guide, Part 20)

Optional step by step guide to NSX Federation in VCF 9.1: deploy the Global Manager, import both Local Managers, enable RTEP stretched networking, and verify sync.

VCF 9.1 Day-2 Operations · Part 20 of 20
Task type: OPTIONAL. This procedure joins two VCF 9.1 instances under one NSX Global Manager, so you manage networking and firewall policy across both from a single console. Run it only when you operate two instances in separate locations and need shared or stretched networking. It depends on two deployed VCF 9.1 instances, each with its own NSX Local Manager and Edge clusters, plus routed connectivity between the sites.
Before you begin. Confirm a healthy, fully backed up fleet before you change federation. Both instances should report green in VCF Operations, and you should hold current backups of each NSX Manager. Walk the VCF 9.x pre-installation checklist first, then continue.
TL;DR
  • Federation is optional and adds one Global Manager console over two or more NSX Local Managers.
  • Deploy Global Manager nodes as a three node cluster, Large form factor, in the management domain of each instance you make active or standby.
  • SDDC Manager does not manage Global Manager lifecycle, so you deploy, back up, and upgrade those nodes by hand.
  • Make one Global Manager cluster active, add a standby, then add each location and import its Local Manager once.
  • For stretched gateways and segments, configure an RTEP on the Edge nodes in every location.
  • Keep round trip latency at 150 ms or less for stretched networks, 500 ms or less otherwise.

NSX Federation gives you a single Global Manager pane over the NSX Local Managers that already run inside each VCF 9.1 instance. From that Global Manager you create tier 0 and tier 1 gateways, segments, and firewall policy once, and it synchronizes each object to only the locations you assign. Each existing NSX Manager becomes a Local Manager after you import it, and it keeps running the daily networking for its own instance.

Because VCF 9.1 builds each instance with its own vCenter, SDDC Manager, and NSX Manager, federation sits on top of the automated build rather than inside it. You deploy and operate the Global Manager nodes yourself, and you keep separate backups for them. This part shows the click by click sequence to stand up federation, import both Local Managers, enable stretched networking, and verify that synchronization works. For how VCF Operations and SDDC Manager divide ownership across the fleet, see the Day-2 operations overview.

Active Global Manager three node cluster Standby Global Manager optional sync VCF Instance A Local Manager A Edge cluster A with RTEP VCF Instance B Local Manager B Edge cluster B with RTEP policy sync policy sync RTEP tunnel Geneve
Figure 1. Federation places an active and standby Global Manager over the Local Manager in each VCF 9.1 instance, while Edge RTEP tunnels carry stretched traffic.

Prerequisites

Confirm each item below before you touch federation. Missing routing or version drift between instances is the usual cause of a stalled import.

ItemRequirementWhere to check
Two VCF 9.1 instancesEach fully deployed with its own vCenter, SDDC Manager, and NSX Manager on 9.1SDDC Manager, VCF Operations
NSX version parityBoth Local Managers on the same NSX version shipped with VCF 9.1NSX Manager, Appliances page
Global Manager capacityCompute and storage for three Global Manager nodes per active and standby clusterManagement domain vCenter
Site to site routingReachability between manager networks and between Edge RTEP networksPhysical network, firewall
Admin credentialsadmin and enterprise admin on each NSX Manager and the Global ManagerCredential store, Part 6

Latency and port requirements

Confirm the values below against the NSX Federation requirements before you add locations.

RequirementValueNotes
Round trip latency, stretched networks150 ms or lessBetween the Global Manager and each location
Round trip latency, non stretched500 ms or lessManagement plane sync only
Manager to manager controlTCP 1235 openGlobal Manager to Local Manager, both directions
RTEP tunnelsUDP 6081 openGeneve traffic between Edge RTEP networks
NSX versionIdentical across instancesImport fails on version drift
Important. SDDC Manager does not deploy, patch, or upgrade the NSX Global Manager nodes. You run those tasks by hand, and when you upgrade an instance you upgrade its Global Manager nodes yourself after the Local Manager. See Part 2 for the fleet upgrade order.
Deploy Global Manager nodes Make cluster active and add standby Add locations and import Local Managers Configure RTEP on Edge nodes Create stretched gateways and segments Verify from Location Manager
Figure 2. Follow this order from top to bottom. Each step depends on the one above it.

Step 1, Deploy the Global Manager nodes

You deploy the Global Manager as a three node cluster in the management domain of the instance that hosts the active cluster. Use the NSX unified appliance OVF and select the Global Manager role. This step uses vCenter.

  1. Log in to the management domain vCenter for the instance that will host the active Global Manager.
  2. Right click the target cluster and select Deploy OVF Template.
  3. Point the wizard at the NSX unified appliance OVA that matches your VCF 9.1 NSX version, then click Next.
  4. On the configuration screen, set the deployment size to Large and set Rolename to NSX Global Manager.
  5. Enter the management IPv4 address, netmask, default gateway, DNS server list, and NTP server list for the first node.
  6. Set the System Root, CLI admin, and Audit passwords, then click Next.
  7. Review the specification, click Finish, and power on the node.
  8. Repeat to deploy two more Global Manager nodes so the cluster has three members.

Step 2, Make the Global Manager cluster active

After the three nodes form a cluster, you set a cluster virtual IP and mark the cluster active. This step uses the NSX Global Manager interface.

  1. Open a browser to the first Global Manager node and sign in as admin.
  2. Go to System, then Appliances, and confirm all three nodes show a stable cluster.
  3. Set the cluster Virtual IP so you reach the Global Manager on one address.
  4. Go to System, then Location Manager.
  5. Click Make Active and enter a name for this Global Manager, for example gm-primary.
  6. Click Save and wait for the status to read Active.

Step 3, Add a standby Global Manager

A standby cluster in the second instance keeps the global configuration available if the active site is lost. This step is optional but recommended for two site designs, and it uses the NSX Global Manager interface.

  1. Deploy a second three node Global Manager cluster in the other instance using Step 1.
  2. On the active Global Manager, go to System, then Location Manager.
  3. Click Add Standby.
  4. Enter the standby cluster FQDN or VIP, its admin credentials, and the node certificate thumbprint.
  5. Click Save and confirm the standby reports a Synced state.

Step 4, Add each location and import the Local Manager

Each existing NSX Manager joins federation as a Local Manager. Import copies its objects into the Global Manager one time, so plan the order and content of each import. This step uses the NSX Global Manager interface.

  1. On the active Global Manager, go to System, then Location Manager.
  2. Click Add Location.
  3. In the Add New Location dialog, enter a location name, the Local Manager FQDN or VIP, and its admin credentials.
  4. Confirm the certificate thumbprint and click Save.
  5. When prompted, choose Import to bring the Local Manager objects into the Global Manager, then confirm.
  6. Repeat for the Local Manager in the second instance.
  7. Watch each location tile until it reports a green, synchronized status.
Note. A Local Manager can complete its import into the Global Manager only once. If a Local Manager contains a centralized transit gateway, remove it before you import, because those objects cannot import into the Global Manager.

Step 5, Configure RTEP on Edge nodes for stretched networking

Stretched gateways and segments send cross location traffic over remote tunnel endpoints. You configure an RTEP on the Edge nodes in each location. This step uses the NSX Local Manager interface.

  1. Sign in to the Local Manager for the first location.
  2. Go to System, then Get Started.
  3. Click Configure Remote Tunnel Endpoint.
  4. Select the Edge Cluster and the Edge nodes that will carry cross location traffic.
  5. Enter the RTEP VLAN and select or create an IP Pool for the RTEP interfaces.
  6. Click Save and wait for the tunnels to come up.
  7. Repeat on the Local Manager in the second location.

You can also reach this from the active Global Manager under System, then Location Manager, then the Networking panel for the location, where Configure on the RTEP row opens the same settings.

Step 6, Create stretched gateways and segments from the Global Manager

With locations added and RTEP up, you build objects once on the Global Manager and assign them to the locations that need them. This step uses the NSX Global Manager interface.

  1. On the active Global Manager, go to Networking, then Tier-0 Gateways.
  2. Click Add Gateway and select Tier-0.
  3. In Locations, add both locations, then set one primary and one secondary for failover.
  4. Save the gateway, then add a Tier-1 Gateway and connect it where needed.
  5. Go to Networking, then Segments, and click Add Segment.
  6. Attach the segment to the stretched gateway, set its Span to both locations, and click Save.

Which console owns each task

Federation spreads work across several consoles, and each one keeps a clear job. Use this mapping so you open the right console for every change and avoid duplicate edits on a Local Manager that the Global Manager already owns.

TaskConsoleNotes
Deploy Global Manager nodesvCenterOVF deploy in the management domain
Make active, add standby, add locationsNSX Global ManagerLocation Manager panel
Import Local Manager objectsNSX Global ManagerOne time per location
Configure RTEP for stretched trafficNSX Local ManagerAlso reachable from the Location Manager networking panel
Create stretched gateways and segmentsNSX Global ManagerAssign span per object
Add hosts or clusters to a domainSDDC ManagerDomain operations stay unchanged by federation
Fleet health and lifecycleVCF OperationsOwns upgrades and health across both instances

Verify the federation is working

Check synchronization from the console first, then confirm state through the API.

  1. On the active Global Manager, open System, then Location Manager, and confirm every location tile is green with no pending sync.
  2. Open the NSX Federation monitoring dashboard and confirm no unresolved alarms for any location.
  3. From a Local Manager, confirm the imported gateways and segments appear with a Global Manager origin.
  4. In VCF Operations, confirm both instances still report healthy after the change.

Query realized state alarms on the Global Manager, then on each Local Manager. An empty results list means no realization errors.

GET https://gm-primary.example.com/global-manager/api/v1/global-infra/realized-state/alarms
GET https://lm-a.example.com/policy/api/v1/infra/realized-state/alarms

For continuous alerting on both instances after federation is live, wire the health checks in Part 18. Because SDDC Manager does not back up the Global Manager, add its nodes to your manual NSX backup routine described in Part 9.

Common errors and fixes

SymptomLikely causeFix
Import fails or hangsVersion drift, or a centralized transit gateway on the Local ManagerMatch NSX versions across instances, remove the centralized transit gateway, then retry the import
Location tile red, control plane downTCP 1235 blocked between Global Manager and Local ManagerOpen the federation ports on the site to site path and confirm routing both ways
Stretched segment carries no cross location trafficRTEP not configured, or Geneve UDP 6081 blocked between Edge networksConfigure RTEP on Edge nodes in both locations, open UDP 6081, and verify tunnels are up
Standby will not syncCertificate thumbprint mismatch, or latency above the limitRe-enter the correct thumbprint and confirm round trip latency stays within the requirement

Common questions

Does SDDC Manager configure NSX Federation for me?
No. Federation is a manual, optional overlay. SDDC Manager and VCF Operations keep managing each instance, while you deploy and operate the Global Manager nodes yourself.

Do I need a standby Global Manager?
Not to start. One active cluster runs federation. A standby cluster in the second instance protects the global configuration if the active site is lost, so most two site designs add one.

Can I stretch a network without RTEP?
No. Cross location segments need remote tunnel endpoints on the Edge nodes in each location. Without RTEP you can still manage both locations from one console, but traffic will not stretch.

How do backups change under federation?
Add the Global Manager to your manual NSX backup routine. See Part 9 for backing up NSX Manager, and remember that SDDC Manager does not cover the Global Manager nodes.

References

VCF 9.1 Day-2 Operations · Part 20 of 20
« Previous: Part 19  |  Complete Guide

About The Author


Discover more from Journal of Intelligent Infrastructure

Subscribe to get the latest posts sent to your email.

Leave a Reply

Your email address will not be published. Required fields are marked *

Architect’s Toolkit

About the Author

Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.

Discover more from Journal of Intelligent Infrastructure

Subscribe now to keep reading and get access to the full archive.

Continue reading