In normal operation, the _vCenter Compute Topology in Ops Mgr shows a connected vCenter Server and its child objects (datacenters, clusters and vSphere hosts) similar to the hierarchy below.
When the VE Service loses connection to vCenter Server:
- The VE Service begins to trigger failure events in its local event log. These events are triggered every poll cycle (5 minutes).
These events are consolidated in the Veeam VMware: Connection lost to VMware vCenter server monitor. After the default consolidation threshold of 5 is reached (25 minutes by default), the monitor will fire.
The 25-minute period is configured so that short-term outages (such as a reboot of vCenter server) do not cause failover, because the rediscovery process caused by failover takes some time to complete and it is desirable to only trigger failover for a genuine sustained vCenter outage. You can modify the default number of consolidated events required to trigger the Veeam VMware: Connection lost to VMware vCenter server monitor by overriding the UnhealthyConsolidatedEventsCount setting for this monitor. The minimum setting is 2 (10 minutes) and the maximum setting is 5 (25 minutes, default).
Note also that the vCenter connection is also independently monitored by every Veeam Collector. If vCenter fails, the first alert(s) received will be from Collector(s) connected to that vCenter. These alerts will appear within 5 minutes, and do not trigger any monitoring reconfiguration.
- When the Veeam VMware: Connection lost to VMware vCenter server monitor fires, an alert is raised in the Ops Mgr console; and a Recovery Action runs to create new direct-to-host connections on each Veeam Collector, bypassing the failed vCenter. This is accomplished using a PowerShell interface into the VE Service.
The Recovery Action output will be available for the Veeam VMware: Connection lost to VMware vCenter server monitor in Health Explorer. You should see that a new connection is configured for each host managed by the failed vCenter.
- The new direct-to-host connections are distributed to all Veeam Collectors using the normal monitoring job distribution method. The failed vCenter connection is not removed, but is ‘unchecked’ (disabled) in the Veeam UI.
The Veeam MP for VMware then rediscovers the VMware topology of hosts and VMs, and monitoring will continue. The _vCenter Compute Topology in Ops Mgr illustrates the new connection method, with multiple direct-to-host connections replacing the failed vCenter connection:
Please note the following limitations:
- The rebuilt topology will not contain vSphere сlusters and datastore clusters, as these are vCenter artefacts and are not available when vCenter is offline. Only vSphere hosts, VMs, Distributed Virtual Switches and Standard vSwitches will be displayed.
- VMs will be re-discovered with a new ID, as the vSphere API used when connecting direct to hosts does not provide the same ID as a vCenter connection. This will result in VMs being re-discovered effectively as ‘new’ VMs in Ops Mgr terms.
Note however that the display name for such VMs in Ops Mgr will be the same — only the underlying Operations Manager ID will be different. This will be transparent for normal monitoring situations, but some gaps may be visible in historical reporting once vCenter is restored and failback has occurred.
- Datastore monitoring for direct-to-host connections is disabled by default. When a failover occurs, datastore monitoring is disabled for directly-connected hosts due to limitations in the host API, which reports shared datastores as multiple duplicate datastores for every host connection. The performance metrics for such datastores are inaccurate, as individual hosts are not aware of other host activities on shared storage. This duplication of datastores can also cause the monitoring load on Collectors and the Ops Mgr system to increase significantly.
For these reasons, datastore monitoring is automatically disabled by default for direct-to-host connections and it is not recommended to enable it when using the vCenter Connection Failover feature.
If monitoring of direct-to-host connections and their attached datastores is a requirement (for example, for remote office/branch office situations, where hosts are not part of a vCenter) then datastore monitoring can be enabled by using the advanced MonitorDatastoresForDirectHost setting in the Veeam UI.
This setting can be applied to a separate monitoring group in the Veeam UI which holds only direct-to-host connections, allowing flexibility to use both direct-to-host and vCenter connection methods in one environment.