, ,

How to Convert Four Sites into Two VCF 9.1 Instances Under One Fleet (VCF 9.1 Deployment Step by Step Guide, Part 24)

A worked multi-site scenario: bring four vSphere 8 sites with NSX 4.2.x and Avi under one VCF 9.1 fleet as two instances, using the convert first approach, then upgrade with Lifecycle Manager.

VCF 9.1 Deployment · Part 24 of 24
Scenario, multi-site. This is a worked example, not a mandatory step. It takes four existing sites and brings them under VCF 9.1 as two instances joined into one fleet, using the convert first approach. It depends on a supported vSphere 8 Update 3 source at each site and the conversion method described in Part 22.
Before you begin. Clear every precheck at each site first. Work through the VCF 9.x pre-installation checklist and confirm your vSphere, NSX and Avi builds against the current Broadcom interoperability matrix for your target 9.1.0.x release.
TL;DR
  • Target: four sites, two VCF instances, one fleet. Instance 1 covers Site A and Site B, Instance 2 covers Site C and Site D, and one VCF Operations plus one VCF Automation manage the whole fleet.
  • Fleet level services (fleet lifecycle, software depot, license server) run only on the first instance. Every extra instance deploys just VCF Services Runtime, Salt master and SDDC lifecycle, and shares the rest.
  • Decide which site becomes the first instance before you start. You cannot relocate an instance after it joins a VCF 9.1 fleet.
  • Convert on the current versions: reuse vSphere 8 Update 3, NSX 4.2.x and Avi in place, then upgrade later with Lifecycle Manager.
  • Order per site: converge the primary site of each instance, import the second site as a workload domain, integrate the second instance into the fleet, then upgrade.
  • Prerequisites: vSphere 8 Update 3 at every site, VCF Installer for the target build, backups, and consistent DNS and NTP across sites.

A customer runs four sites on vSphere 8 with NSX 4.2.x and Avi load balancer. They want a single VCF 9.1 fleet, but not a single instance. Two sites, A and B, should sit in one instance, and the other two, C and D, in a second instance, with one fleet management layer over both. This part shows how to reach that layout with the convert first approach, so nothing is upgraded before it is under management.

You will converge each environment on its current versions, stand up the fleet on the first instance, join the second instance to the fleet, bring Avi under management, then upgrade every component to 9.1 through Lifecycle Manager. For the underlying mechanics of a single conversion, read Part 22, and for attaching an existing vCenter, read Part 21.

Target architecture for this scenario

Fleet Managementone VCF Operations and one VCF Automation VCF Instance 1first instance, hosts fleet services VCF Instance 2shares fleet services from Instance 1 Site AvSphere 8NSX 4.2.x, Avi Site BvSphere 8NSX 4.2.x, Avi Site CvSphere 8NSX 4.2.x, Avi Site DvSphere 8NSX 4.2.x, Avi Convert each site on its current versions, then upgrade to 9.1 with Lifecycle Manager
One fleet, two instances, four sites. Instance 1 holds the shared fleet services, and Instance 2 shares them.
SiteInstanceRole in the conversion
Site AInstance 1Primary site, converged first, brings up the fleet
Site BInstance 1Imported into Instance 1 as a workload domain
Site CInstance 2Primary site of the second instance, joins the fleet
Site DInstance 2Imported into Instance 2 as a workload domain

How the fleet and instances fit together

A VCF fleet is one or more VCF instances managed by a single VCF Operations and a single VCF Automation. Fleet level components, meaning fleet lifecycle, the software depot and the license server, run only on the first instance. Every additional instance deploys just VCF Services Runtime, a Salt master and SDDC lifecycle, and consumes the shared services from the first instance. In this scenario Instance 1 is the first instance, so it carries the fleet services, and Instance 2 is lighter and points back to Instance 1.

Important, decide the layout first

There is no supported way to relocate a VCF instance once it has joined a VCF 9.1 fleet. Choose which site is the first instance, and which sites belong to which instance, before you converge anything. Confirm that the two sites in each instance sit within the management latency VCF supports.

Prerequisites

ItemRequirement
Source vSpherevSphere 8 Update 3 host and vCenter at all four sites
NSXNSX 4.2.x at each site, reused in place during conversion
Avi load balancerExisting Avi controllers documented, so they can be reused or redeployed under VCF Operations
Enhanced Linked ModeRemoved at every site, since converge expects a standalone vCenter target
VCF InstallerVCF Installer appliance OVA for the target 9.1.0.x build
Networking, DNS, NTPForward and reverse DNS and consistent NTP across all sites, with management networks reachable between the two sites of each instance
BackupsVerified vCenter and NSX Manager backups at each site before every window

Conversion sequence at a glance

Converge Site AInstance 1 and fleet Import Site Binto Instance 1 Converge Site CInstance 2, joins fleet Import Site Dinto Instance 2 Upgrade via LCMeach instance to 9.1 CONVERT FIRST, UPGRADE LATER
Convert each site on its current versions in this order, then run the upgrades once everything is under fleet management.

Step 1, plan the fleet and instance layout

Fix the design before any conversion. Because an instance cannot move between fleets later, this decision is final in practice.

  • Pick Site A as the first instance, so Instance 1 carries the shared fleet services.
  • Assign Site B to Instance 1, and Sites C and D to Instance 2.
  • Confirm the two sites in each instance meet VCF management latency limits.
  • Reserve management IP ranges, FQDNs and a spare IP per vCenter for the later upgrades.

Step 2, validate and remediate every site

Run a dry validation at each site days ahead of its window.

  1. Deploy the VCF Installer at the site and run its validation as a dry run.
  2. Remove Enhanced Linked Mode so the vCenter is a standalone target.
  3. Remediate the distributed switch to a VCF supported configuration.
  4. Record the current Avi controller and service engine configuration.
  5. Take a verified backup of vCenter and NSX Manager.

Step 3, converge Site A to create the first instance and the fleet

Site A becomes Instance 1 and brings up the fleet management layer.

  1. In the installer at Site A, choose the Converge existing environment workflow.
  2. Select the existing vCenter on vSphere 8 Update 3 to reuse.
  3. Select the existing NSX instance on 4.2.x to reuse, not upgrade.
  4. Enter deployment details for SDDC Manager and the fleet services, meaning VCF Operations, VCF Automation, the Software Depot and the License Server.
  5. Click Validate, clear any finding, then click Finish to execute.

Step 4, import Site B into the first instance

Site B joins Instance 1 as a workload domain, on its current version.

  1. In the Instance 1 fleet console, start the Import workflow.
  2. Select the Site B vCenter to attach on its current version.
  3. Click Run Prechecks, resolve anything red, then click Finish.
  4. Confirm Site B shows as a managed domain in VCF Operations.

Step 5, converge Site C to create the second instance and join the fleet

Site C becomes Instance 2. It does not repeat the fleet services, it shares them from Instance 1.

  1. Deploy the VCF Installer at Site C and choose the Converge existing environment workflow.
  2. Select the Site C vCenter on vSphere 8 Update 3 and its NSX on 4.2.x to reuse.
  3. Deploy only VCF Services Runtime, the Salt master and SDDC lifecycle for this instance.
  4. In VCF Operations, integrate Instance 2 into the existing fleet so it shares the fleet services.
  5. Click Validate, then click Finish.

Step 6, import Site D into the second instance

  1. In the fleet console, start the Import workflow for Instance 2.
  2. Select the Site D vCenter to attach on its current version.
  3. Click Run Prechecks, then click Finish.
  4. Confirm all four sites now show under the one fleet in VCF Operations.

Step 7, bring Avi under fleet management

Each site keeps its Avi load balancing. You register the existing Avi with the fleet, and for small footprints VCF 9.1 can deploy a single node Avi cluster from VCF Operations. For a full walkthrough of Avi in VCF, see Part 12.

  1. In VCF Operations, open the Load Balancer area.
  2. Register each site existing Avi controller with the fleet.
  3. Confirm the load balancer status reports healthy for every domain.

Step 8, upgrade every instance to 9.1 with Lifecycle Manager

All four sites are now under one fleet, still on 8.x. You do not upgrade by hand. Lifecycle Manager, called LCM, runs each upgrade. For every component the job is the same: pick it, run a precheck, then start it. LCM enforces the order and blocks a failed precheck.

Run the same loop for each component, one instance at a time:

  1. Open Lifecycle Management in the fleet console.
  2. Pick the component and its 9.1 target bundle.
  3. Click Run Prechecks and wait for a green result.
  4. If a check is red, fix it and run Run Prechecks again before you continue.
  5. Click Upgrade Now, or Schedule for a maintenance window.
  6. Confirm the component is healthy in VCF Operations, then move to the next.

The order LCM follows is VCF Operations, then SDDC and Fleet, then NSX, then vCenter, then ESXi, then NSX Edge, and finally Avi. Because the sites start on NSX 4.2.x, LCM may move NSX to 9.1 in two hops, each its own window. Upgrade Instance 1 first, then Instance 2.

Note

Convert all four sites before you start any upgrade. That way every site is under management and recoverable, and you can run the upgrade windows for the two instances on separate schedules.

Verify the deployment

  • One fleet shows two instances in VCF Operations, and all four sites appear as managed domains.
  • Fleet services run on Instance 1, and Instance 2 reports that it shares them.
  • Certificate and password management has moved to VCF at every site.
  • Avi reports healthy for each domain that uses it.
  • The Software Depot is reachable and prechecks pass for the next component.
  • After upgrade, NSX, vCenter, ESXi and Avi are on 9.1 and interoperability is green.

Common errors and fixes

SymptomCause and fix
Second instance tries to redeploy fleet servicesInstance 2 was not integrated into the existing fleet. Point it at the fleet on Instance 1 so it deploys only Runtime, Salt master and SDDC lifecycle.
Validation fails on linked vCentersEnhanced Linked Mode is still set. Remove ELM at that site so the target is standalone.
NSX upgrade will not startWrong hop order from 4.2.x. Take the interim hop first, then the 9.1 build, and clear every precheck.
Avi shows unmanaged after conversionAvi was not registered with the fleet. Register the controller in VCF Operations, or redeploy a single node cluster from there.
Site placed in the wrong instanceAn instance cannot move between fleets later. Plan the layout up front, since correcting it means a rebuild of that instance.

Common questions

Why two instances instead of one
Two instances keep each pair of sites in its own management and lifecycle boundary while one fleet gives unified operations. It suits customers who want separation between site groups but a single pane for the whole estate.

Do both instances need their own VCF Operations
No. One VCF Operations and one VCF Automation manage the whole fleet. Only the first instance runs the fleet services, and the second instance shares them.

Can I convert all four sites at once
You can run the site conversions in parallel where staffing allows, since each converts on its own versions. Build Instance 1 first though, because it hosts the fleet services the second instance depends on.

What happens to Avi during the move
Avi is reused in place, registered with the fleet, and upgraded last through LCM. Small sites can use a single node Avi cluster deployed from VCF Operations.

References

VCF 9.1 Deployment · Part 24 of 24
« Previous: Part 23  |  Complete Guide

About The Author


Discover more from Journal of Intelligent Infrastructure

Subscribe to get the latest posts sent to your email.

Leave a Reply

Your email address will not be published. Required fields are marked *

Architect’s Toolkit

About the Author

Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.

Discover more from Journal of Intelligent Infrastructure

Subscribe now to keep reading and get access to the full archive.

Continue reading