Replicating data to and from the cloud Edit on GitHub

You can replicate data between working environments. You can choose a one-time data replication to move data to and from the cloud, or a recurring schedule for disaster recovery or long-term retention.

Cloud Manager simplifies data replication between volumes on separate systems. You simply need to identify the source volume and the destination volume, and then choose a replication policy and schedule. Cloud Manager purchases the required disks, configures relationships, applies the replication policy, and then initiates the baseline transfer between volumes.

The baseline transfer includes a full copy of the source data. Subsequent transfers contain differential copies of the source data.

Shows a source system and volume and the destination system and volume to which the data will be replicated.

Choosing a replication policy

A replication policy defines how the storage system replicates data from a source volume to a destination volume. You must choose a replication policy when you set up data replication in Cloud Manager.

What replication policies do

The ONTAP operating system automatically creates backups called Snapshot copies. A Snapshot copy is a read-only image of a volume that captures the state of the file system at a point in time.

When you replicate data between systems, you replicate Snapshot copies from a source volume to a destination volume. A replication policy specifies which Snapshot copies to replicate from the source volume to the destination volume.

Replication policies are also referred to as protection policies because they are part of SnapMirror and SnapVault technologies that provide disaster recovery protection and disk-to-disk backup and recovery.

The following image shows the relationship between Snapshot copies and replication policies:

This illustration shows Snapshot copies on a source volume and a replication policy that specifies replication of all or specific Snapshot copies from the source volume to the destination volume.

Types of replication policies

There are three types of replication policies:

  • A SnapMirror policy replicates newly created Snapshot copies to a destination volume.

    You can use these Snapshot copies to protect the source volume in preparation for disaster recovery or for one-time data replication. You can activate the destination volume for data access at any time.

  • A SnapVault policy replicates specific Snapshot copies to a destination volume and typically retains them for a longer period of time than you would on the source volume.

    You can restore data from these Snapshot copies when data is corrupted or lost, and retain them for standards compliance and other governance-related purposes.

  • A SnapMirror and SnapVault policy provides both disaster recovery and long-term retention.

    Each system includes default SnapMirror and SnapVault policies, which work well for many situations. If you find that you need custom policies, you can create your own using System Manager.

The following images show the difference between SnapMirror and SnapVault. A SnapMirror policy mirrors the Snapshot copies available on the source volume.

This illustration shows Snapshot copies on a source volume and a SnapMirror destination volume that mirrors the source volume.^

A SnapVault policy typically retains Snapshot copies longer than they are retained on the source volume:

This illustration shows Snapshot copies on a source volume and a SnapVault destination volume that includes more Snapshot copies because SnapVault retains Snapshot copies for long-term retention.^

How SnapVault policies work

Unlike SnapMirror, SnapVault replicates specific Snapshot copies to a destination volume, as defined by a SnapVault policy. It is important to understand how SnapVault policies work if you want to use your own policies instead of the default policies.

Understanding the relationship between Snapshot copy labels and SnapVault policies

A Snapshot policy defines how the system creates Snapshot copies of volumes. The policy specifies when to create the Snapshot copies, how many copies to retain, and how to label them. For example, a system might create one Snapshot copy every day at 12:10 a.m., retain the two most recent copies, and label them "daily".

A SnapVault policy includes rules that specify which labeled Snapshot copies to replicate to a destination volume and how many copies to retain. The labels defined in a SnapVault policy must match one or more labels defined in a Snapshot policy. Otherwise, the system cannot replicate any Snapshot copies.

For example, a SnapVault policy that includes the labels "daily" and "weekly" results in replication of Snapshot copies that include only those labels. No other Snapshot copies are replicated, as shown in the following image:

This illustration shows a Snapshot policy

Default policies and custom policies

The default Snapshot policy creates hourly, daily, and weekly Snapshot copies, retaining six hourly, two daily, and two weekly Snapshot copies.

You can easily use a default SnapVault policy with the default Snapshot policy. The default SnapVault policies replicate daily and weekly Snapshot copies, retaining seven daily and 52 weekly Snapshot copies.

If you create custom policies, the labels defined by those policies must match. You can create custom policies using System Manager.

Data replication requirements

Before you can replicate data, you should confirm that specific requirements are met for both ONTAP Cloud systems and ONTAP clusters.

Version requirements

You should verify that the source and destination volumes are running compatible ONTAP versions before replicating data. For details, see the Data Protection Power Guide.

Requirements specific to ONTAP Cloud
  • The instance’s security group must include the required inbound and outbound rules: specifically, rules for ICMP and ports 10000, 11104, and 11105.

    These rules are included in the predefined security group.

  • To replicate data between two ONTAP Cloud systems in different subnets, the subnets must be routed together (this is the default setting).

  • To replicate data between an ONTAP Cloud system in AWS and a system in Azure, you must have a VPN connection between the AWS VPC and the Azure VNet.

Requirements specific to ONTAP clusters
  • An active SnapMirror license must be installed.

  • If the cluster is on your premises, you should have a connection from your corporate network to AWS or Azure, which is typically a VPN connection.

  • ONTAP clusters must meet additional subnet, port, firewall, and cluster requirements.

    For details, see the Cluster and SVM Peering Express Guide for your version of ONTAP.

Replicating data between systems

You can replicate data between ONTAP Cloud systems and ONTAP clusters by choosing a one-time data replication, which can help you move data to and from the cloud, or a recurring schedule, which can help with disaster recovery or long-term retention.

About this task

Cloud Manager supports simple, fanout, and cascade data protection configurations:

  • In a simple configuration, replication occurs from volume A to volume B.

  • In a fanout configuration, replication occurs from volume A to multiple destinations, which can be SnapMirror or SnapVault destinations.

    Only one SnapVault relationship is allowed in a fanout configuration.
  • In a cascade configuration, replication occurs from volume A to volume B and from volume B to volume C.

You can configure fanout and cascade configurations in Cloud Manager by setting up multiple data replications between systems. For example, by replicating a volume from system A to system B and then by replicating the same volume from system B to system C.

Steps
  1. On the Working Environments page, select the working environment that contains the source volume, and then drag it to the working environment to which you want to replicate the volume:

    Screen shot: Shows a working environment being placed on top of another working environment to start the data replication process.

  2. If the Source and Destination Peering Setup pages appear, select all of the intercluster LIFs for the cluster peer relationship.

    The intercluster network should be configured so that cluster peers have pair-wise full-mesh connectivity, which means that each pair of clusters in a cluster peer relationship has connectivity among all of their intercluster LIFs.

    These pages appear if an ONTAP cluster that has multiple LIFs is the source or destination.

  3. On the Source Volume Selection page, select the volume that you want to replicate.

  4. On the Destination Volume Name and Tiering page, specify the destination volume name, choose an underlying disk type, change any of the advanced options, and then click Continue.

    If the destination is an ONTAP cluster, you must also specify the destination SVM and aggregate.

  5. On the Max Transfer Rate page, specify the maximum rate (in megabytes per second) at which data can be transferred.

  6. On the Replication Policy page, choose one of the default policies or click Additional Policies, and then select one of the advanced policies.

    If you choose a custom SnapVault policy, the labels associated with the policy must match the labels of the Snapshot copies on the source volume. For more information, see How SnapVault policies work.

  7. On the Schedule page, choose a one-time copy or a recurring schedule.

    Several default schedules are available. If you want a different schedule, you must create a new schedule on the destination cluster using System Manager.

  8. On the Review page, review your selections, and then click Go.

Result

Cloud Manager starts the data replication process. You can view details about the replication in the Replication Status page.

Managing data replication schedules and relationships

After you set up data replication between two systems, you can manage the data replication schedule and relationship from Cloud Manager.

Steps
  1. On the Working Environments page, view the replication status for all assigned working environments in the tenant or for a specific working environment:

    Option Action

    All assigned working environments in the tenant

    Click Replication Status from the navigation bar.

    Screen shot: Shows the Replication Status tab.

    A specific working environment

    Select the working environment, and then click Replication Status.

    Screen shot: Shows the Replication Status icon available from the working environments page.

  2. Review the status of the data replication relationships to verify that they are healthy.

    If the Status of a relationship is idle and the Mirror State is uninitialized, you must initialize the relationship from the destination system for the data replication to occur according to the defined schedule. You can initialize the relationship by using System Manager or the command-line interface (CLI). These states can appear when the destination system fails and then comes back online.
  3. Select the menu icon next to the source volume, and then choose one of the available actions.

    Screen shot: Shows the list of actions available from the Replication Status page.

    The following table describes the available actions:

    Action Description

    Break

    Breaks the SnapMirror relationship between the source and destination volumes, and activates the destination volume for data access.

    This option is typically used when the source volume cannot serve data due to events such as data corruption, accidental deletion, or an offline state.

    For information about configuring a destination volume for data access and reactivating a source volume, see the ONTAP 9 Volume Disaster Recovery Express Guide.

    Resync

    Reestablishes a broken SnapMirror relationship between volumes and resumes data replication according to the defined schedule.

    When you resynchronize the volumes, the contents on the destination volume are overwritten by the contents on the source volume.

    To perform a reverse resync, which resynchronizes the data from the destination volume to the source volume, see the ONTAP 9 Volume Disaster Recovery Express Guide.

    Reverse Resync

    Reverses the roles of the source and destination volumes. Contents from the original source volume are overwritten by contents of the destination volume. This is helpful when you want to reactivate a source volume that went offline.

    Any data written to the original source volume between the last data replication and the time that the source volume was disabled is not preserved.

    Edit Schedule

    Enables you to choose a different schedule for data replication.

    Policy Info

    Shows you the protection policy assigned to the data replication relationship.

    Edit Max Transfer Rate

    Enables you to edit the maximum rate (in kilobytes per second) at which data can be transferred.

    Delete

    Deletes the data protection relationship between the source and destination volumes, which means that data replication no longer occurs between the volumes. This action does not activate the destination volume for data access. This action also deletes the cluster peer relationship and the storage virtual machine (SVM) peer relationship, if there are no other data protection relationships between the systems.

Result

After you select an action, Cloud Manager updates the relationship or schedule.