Veeam Backup & Replication 9.5 Update 4
User Guide for VMware vSphere
Related documents

Indexes

To reduce the amount of cost-expensive operations incurred by your cloud storage provider, as well as to decrease redundant traffic being sent over the network while offloading your data to object storage repositories, Veeam Backup & Replication uses indexes.

Indexes behavior is as follows:

  • Indexes are created (or updated) during each offload session and consist of hash values of blocks that are being transferred to the object storage repository. These hashes are retrieved from meta information of your backup files (.vbk, .vib, or .vrb).
  • Indexes are stored in the ArchiveIndex directory that is located on the source extent from which the backup data was offloaded.

On each subsequent offload session, Veeam will reuse these indexes to verify whether new blocks that are about to be transferred to the object storage repository have not been offloaded earlier. Verification is done by comparing existing indexes hashes with that of a block being transferred.

  • Indexes are built per backup chain and cannot have any cross references to any other backup chains.
  • Indexes are updated every time a backup chain is modified. For example, some data might have been removed due to the retention policy threshold, or you may have removed it manually. Both scenarios will modify your indexes upon the next successful offload session to maintain consistency.
  • Corrupted indexes can be rebuilt anew by using the Rescan feature, as described in Rescanning Scale-Out Repositories.

Once rebuilt, Veeam will have to wait for 24 hours before it can offload any data again. This is done to comply with the Eventual Consistency model of Amazon S3.

ArchiveIndex Directory Structure

When Veeam creates indexes, it also creates and maintains the following directory structure on each extent from which the data is being offloaded.

Indexes 

Directory

Description

ArchiveIndex

The root directory for keeping indexes. This directory is created in the repository of an extent.

<backup_id>

Contains objects in a backup file.

<objects_in_backup_id>

An identifier of an object in a backup file.

  • If a backup was created using the Per-VM method, then each VM will be placed to its own directory.
  • If a backup was created as a single storage, then all the VMs will be placed to a single directory.

stg_index

Contains actual indexes of the offloaded backup files (.vbk, .vib, or .vrb).

index_data.vbk

Contains meta information on hash values stored in index files.

Related Topics

This Document Help Center
User Guide for VMware vSphereUser Guide for Microsoft Hyper-VEnterprise Manager User GuideVeeam Cloud Connect GuideVeeam Agent Management GuideVeeam Explorers User GuideBackup and Restore of SQL Server DatabasesVeeam Plug-ins for Enterprise ApplicationsPowerShell ReferenceVeeam Explorers PowerShell ReferenceRESTful API ReferenceRequired Permissions ReferenceQuick Start Guide for VMware vSphereQuick Start Guide for Microsoft Hyper-VVeeam Backup for AWS DocumentationVeeam Availability for Nutanix AHV DocumentationVeeam Backup for Microsoft Office 365 DocumentationVeeam ONE DocumentationVeeam Agent for Windows DocumentationVeeam Agent for Linux DocumentationVeeam Management Pack Documentation
I want to report a typo

There is a misspelling right here:

 

I want to let the Veeam Documentation Team know about that.