Open topic with navigation

Creating a data migration job

Use the following instructions to create a data migration job.

1. Click Get Started from the toolbar.

2. Select Double-Take Move and click Next.

3. Choose your source server. This is the server that contains the data that you want to migrate.

   

   • Current Servers—This list contains the servers currently available in your console session. Servers that are not licensed for the workflow you have selected will be filtered out of the list. Select your source server from the list.
   • Find a New Server—If the server you need is not in the Current Servers list, click the Find a New Server heading. From here, you can specify a server along with credentials for logging in to the server. If necessary, you can click Browse to select a server from a network drill-down list.

   If you enter the source server's fully-qualified domain name, the Double-Take Console will resolve the entry to the server short name. If that short name resides in two different domains, this could result in name resolution issues. In this case, enter the IP address of the server.

   When specifying credentials for a new server, specify a user that is a member of the local Double-Take Admin and local administrator security groups on the source.

    

4. Click Next to continue.

5. Choose the type of workload that you want to migrate. Under Server Workloads, in the Workload types pane, select Data Migration. In the Workload items pane, if desired, you can select the entire volumes on the source that yo want to protect.

6. To select your files and folders in more detail, click the Replication Rules heading and expand the volumes under Folders.

   

   Volumes and folders with a green highlight are included in their entirety in the migration. Volumes and folders highlighted in light yellow have individual files included in the migration. If there is no highlight, no part of the volume or folder is included in the migration. To modify the items selected, highlight a volume, folder, or file and click Add Rule. You can also enter a rule, including a wildcard specification, manually. Specify if you want to Include or Exclude the item. Also, specify if you want the rule to be recursive, which indicates the rule should automatically be applied to the subdirectories of the specified path. If you do not select Recursive, the rule will not be applied to subdirectories.

   If you need to remove a rule, highlight it in the list at the bottom and click Remove Rule. Be careful when removing rules. Double-Take may create multiple rules when you are adding directories. For example, if you add E:\Data to be included in protection, then E:\ will be excluded. If you remove the E:\ exclusion rule, then the E:\Data rule will be removed also.

7. Click Next to continue.

8. Choose your target server. This is the server that will receive the migrated data from the source.

   

   • Current Servers—This list contains the servers currently available in your console session. Servers that are not licensed for the workflow you have selected and those not applicable to the workload type you have selected will be filtered out of the list. Select your target server from the list.
   • Find a New Server—If the server you need is not in the Current Servers list, click the Find a New Server heading. From here, you can specify a server along with credentials for logging in to the server. If necessary, you can click Browse to select a server from a network drill-down list.

   If you enter the target server's fully-qualified domain name, the Double-Take Console will resolve the entry to the server short name. If that short name resides in two different domains, this could result in name resolution issues. In this case, enter the IP address of the server.

   When specifying credentials for a new server, specify a user that is a member of the local Double-Take Admin and local administrator security groups on the source.

    

9. Click Next to continue.

10. You have many options available for your data migration job. Configure those options that are applicable to your environment.

    Click a link below to see the options available for that section of the Set Options page.

    General

    

    For the Job name, specify a unique name for your job.

    Failover Options

    

    • Wait for user to initiate failover—By default, the cutover process will wait for you to initiate it, allowing you to control when cutover occurs. When a cutover occurs, the job will wait in the Protecting state for you to manually initiate the cutover process. Disable this option only if you want cutover to occur immediately after the mirror is complete.
    • Shutdown source server—Specify if you want to shut down the source server, if it is still running, before the source is cutover to the target, This option prevents identity conflicts on the network in those cases where the source and target are still both running and communicating.

    • Scripts—You can customize cutover by running scripts on the target. Scripts may contain any valid Windows command, executable, or batch file. The scripts are processed using the same account running the Double-Take service, unless you have identified a specific account through the server's properties. See Script credentials. Examples of functions specified in scripts include stopping services on the target before cutover because they may not be necessary, stopping services on the target that need to be restarted with the source’s machine name and/or IP address, starting services or loading applications that are in an idle, standby mode waiting for cutover to occur, notifying the administrator before and after cutover occurs, and so on. There are two types of cutover scripts.

      • Pre-failover script—This script runs on the target at the beginning of the cutover process. Specify the full path and name of the script file.
      • Post-failover script—This script runs on the target at the end of the cutover process. Specify the full path and name of the script file.
      • Arguments—Specify a comma-separated list of valid arguments required to execute the script.
      • Delay until script completes—Enable this option if you want to delay the cutover process until the associated script has completed. If you select this option, make sure your script handles errors, otherwise the cutover process may never complete if the process is waiting on a script that cannot complete.

      Scripts will run but will not be displayed on the screen if the Double-Take service is not set to interact with the desktop. Enable this option through the Windows Services applet.

    Mirror, Verify & Orphaned Files

    

    • Mirror all files—All protected files will be mirrored from the source to the target.
    • Mirror different files—Only those protected files that are different based on date and time, size, or attributes will be mirrored from the source to the target.

    • Mirror only if the file on the source is newer than the copy on the target—Only those protected files that are newer on the source are mirrored to the target.

      If you are using a database application or are protecting a domain controller, do not use this option unless you know for certain that you need it. With database applications and because domain controllers store their data in a database, it is critical that all files, not just some of the files that might be newer, get mirrored.

       

    • Use block checksum for comparisons—For those files flagged as different, the mirroring process can perform a block checksum comparison and send only those blocks that are different.

    • Enable scheduled verification—Verification is the process of confirming that the source replica data on the target is identical to the original data on the source. Verification creates a log file detailing what was verified as well as which files are not synchronized. If the data is not the same, can automatically initiate a remirror, if configured. The remirror ensures data integrity between the source and target. When this option is enabled, Double-Take will verify the source replica data on the target and generate a verification log.

      Because of the way the Windows Cache Manager handles memory, machines that are doing minimal or light processing may have file operations that remain in the cache until additional operations flush them out. This may make Double-Take files on the target appear as if they are not synchronized. When the Windows Cache Manager releases the operations in the cache on the source and target, the files will be updated on the target.

       

    • Verify on this interval—Specify the interval between verification processes.
    • Begin immediately—Select this option if you want to start the verification schedule immediately after the job is established.
    • Begin at this time—Select this option if you want to start the verification at the specified date and time.
    • Mirror files to the target server when verifying—When this option is enabled, in addition to verifying the data and generating a log, Double-Take will also mirror to the target any protected files that are different on the source.

    • Mirror only if the file on the source is newer than the copy on the target—Only those protected files that are newer on the source are mirrored to the target.

      If you are using a database application or are protecting a domain controller, do not use this option unless you know for certain that you need it. With database applications and because domain controllers store their data in a database, it is critical that all files, not just some of the files that might be newer, get mirrored.

       

    • Use block checksum for comparisons—For those files flagged as different, the mirroring process can perform a block checksum comparison and send only those blocks that are different.

    • Calculate size of protected data before mirroring—Specify if you want Double-Take to determine the mirroring percentage calculation based on the amount of data being protected. If the calculation is enabled, it is completed before the job starts mirroring, which can take a significant amount of time depending on the number of files and system performance. If your job contains a large number of files, for example, 250,000 or more, you may want to disable the calculation so that data will start being mirrored sooner. Disabling calculation will result in the mirror status not showing the percentage complete or the number of bytes remaining to be mirrored.

      The calculated amount of protected data may be slightly off if your data set contains compressed or sparse files.

       

    • Delete orphaned files—An orphaned file is a file that exists in the replica data on the target, but does not exist in the protected data on the source. This option specifies if orphaned files should be deleted on the target during a mirror, verification, or restoration.

      Orphaned file configuration is a per target configuration. All jobs to the same target will have the same orphaned file configuration.

      The orphaned file feature does not delete alternate data streams. To do this, use a full mirror, which will delete the additional stream(s) when the file is re-created.

      If delete orphaned files is enabled, carefully review any replication rules that use wildcard definitions. If you have specified wildcards to be excluded from protection, files matching those wildcards will also be excluded from orphaned file processing and will not be deleted from the target. However, if you have specified wildcards to be included in your protection, those files that fall outside the wildcard inclusion rule will be considered orphaned files and will be deleted from the target.

      If you want to move orphaned files rather than delete them, you can configure this option along with the move deleted files feature to move your orphaned files to the specified deleted files directory. See Target server properties for more information.

      During a full mirror, orphaned file processing success messages will be logged to a separate orphaned file log. This keeps the Double-Take log from being overrun with orphaned file success processing messages. Orphaned files processing statistics and any errors in orphaned file processing will still be logged to the Double-Take log, and during difference mirrors, verifications, and restorations, all orphaned file processing messages are logged to the Double-Take log. The orphaned file log is located in the Logging folder specified for the source. See Log file properties for details on the location of that folder. The orphaned log file is overwritten during each orphaned file processing during a full mirror, and the log file will be a maximum of 50 MB.

       

    Network Route

    

    • Send data to the target server using this route—By default, Double-Take will select a target route for transmissions. If desired, specify an alternate route on the target that the data will be transmitted through. This allows you to select a different route for Double-Take traffic. For example, you can separate regular network traffic and Double-Take traffic on a machine with multiple IP addresses.

      The IP address used on the source will be determined through the Windows route table.

       

    • Block target paths upon connection—You can block writing to the replica source data located on the target. This keeps the data from being changed outside of Double-Take processing. Any target paths that are blocked will be unblocked automatically during the cutover process so that users can modify data after cutover.
    Path Mapping

    

    For the Mappings, specify the location on the target where the replica of the source data will be stored. By default, the replica source data will be stored in the same directory structure on the target, in a one-to-one configuration. Make sure you update this location if you are protecting multiple sources or jobs to the same target. Double-Take offers two pre-defined locations as well as a custom option that allows you to set your path.

    • All To One—Click this button to set the mapping so that the replica source data will be stored on a single volume on the target. The pre-defined path is \source_name\volume_name. If you are protecting multiple volumes on the source, each volume would be stored on the same volume on the target. For example, C:\data and D:\files for the source Alpha would be stored in D:\alpha\C and D:\alpha\D, respectively.
    • One To One—Click this button to set the mapping so that the replica source data will be stored in the same directory structure on the target. For example, C:\data and D:\files on the source will be stored in C:\data and D:\files, respectively, on the target.
    • Custom Location—If the pre-defined options do not store the data in a location that is appropriate for your network operations, you can specify your own custom location where the replica source data will be stored. Click the Target Path and edit it, selecting the appropriate location.

    If you are protecting dynamic volumes or mount points, your location on the target must be able to accommodate the amount of data that may be stored on the source.

    If you are protecting multiple mount points, your directory mapping must not create a cycle or loop. For example, if you have the C: volume mounted at D:\C and the D: volume mounted at C:\D, this is a circular configuration. If you establish a job for either C:\D or D:\C, there will be a circular configuration and Double-Take mirroring will never complete.

    If you are protecting sparse files and your location on the target is a non-NTFS 5 volume, the amount of disk space available must be equal to or greater than the entire size of the sparse file. If the target location is an NTFS 5 volume, the amount of disk space available must be equal to or greater than the on-disk size of the sparse file.

     

    Compression

    

    To help reduce the amount of bandwidth needed to transmit Double-Take data, compression allows you to compress data prior to transmitting it across the network. In a WAN environment this provides optimal use of your network resources. If compression is enabled, the data is compressed before it is transmitted from the source. When the target receives the compressed data, it decompresses it and then writes it to disk. You can set the level from Minimum to Maximum to suit your needs.

    Keep in mind that the process of compressing data impacts processor usage on the source. If you notice an impact on performance while compression is enabled in your environment, either adjust to a lower level of compression, or leave compression disabled. Use the following guidelines to determine whether you should enable compression.

    • If data is being queued on the source at any time, consider enabling compression.
    • If the server CPU utilization is averaging over 85%, be cautious about enabling compression.
    • The higher the level of compression, the higher the CPU utilization will be.
    • Do not enable compression if most of the data is inherently compressed. Many image (.jpg, .gif) and media (.wmv, .mp3, .mpg) files, for example, are already compressed. Some images files, such as .bmp and .tif, are uncompressed, so enabling compression would be beneficial for those types.
    • Compression may improve performance even in high-bandwidth environments.
    • Do not enable compression in conjunction with a WAN Accelerator. Use one or the other to compress Double-Take data.

    All jobs from a single source connected to the same IP address on a target will share the same compression configuration.

     

    Bandwidth

    

    Bandwidth limitations are available to restrict the amount of network bandwidth used for Double-Take data transmissions. When a bandwidth limit is specified, Double-Take never exceeds that allotted amount. The bandwidth not in use by Double-Take is available for all other network traffic.

    All jobs from a single source connected to the same IP address on a target will share the same bandwidth configuration.

     

    • Do not limit bandwidth—Double-Take will transmit data using 100% bandwidth availability.
    • Use a fixed limit—Double-Take will transmit data using a limited, fixed bandwidth. Select a Preset bandwidth limit rate from the common bandwidth limit values. The Bandwidth field will automatically update to the bytes per second value for your selected bandwidth. This is the maximum amount of data that will be transmitted per second. If desired, modify the bandwidth using a bytes per second value. The minimum limit should be 3500 bytes per second.
    • Use scheduled limits—Double-Take will transmit data using a dynamic bandwidth based on the schedule you configure. Bandwidth will not be limited during unscheduled times.
    • New—Click New to create a new scheduled bandwidth limit. Specify the following information.
    • Daytime entry—Select this option if the start and end times of the bandwidth window occur in the same day (between 12:01 AM and midnight). The start time must occur before the end time.
    • Overnight entry—Select this option if the bandwidth window begins on one day and continues past midnight into the next day. The start time must be later than the end time, for example 6 PM to 6 AM.
    • Day—Enter the day on which the bandwidth limiting should occur. You can pick a specific day of the week, Weekdays to have the limiting occur Monday through Friday, Weekends to have the limiting occur Saturday and Sunday, or Every day to have the limiting repeat on all days of the week.
    • Start time—Enter the time to begin bandwidth limiting.
    • End time—Enter the time to end bandwidth limiting.
    • Preset bandwidth—Select a bandwidth limit rate from the common bandwidth limit values. The Bandwidth field will automatically update to the bytes per second value for your select bandwidth.
    • Bandwidth—If desired, modify the bandwidth using a bytes per second value. The minimum limit should be 3500 bytes per second.
    • Edit—Click Edit to modify an existing scheduled bandwidth limit.
    • Delete—Click Delete to remove a scheduled bandwidth limit.

    If you change your job option from Use scheduled limits to Do not limit bandwidth or Use a fixed limit, any schedule that you created will be preserved. That schedule will be reused if you change your job option back to Use scheduled limits.

    You can manually override a schedule after a job is established by selecting Other Job Options, Set Bandwidth. If you select No bandwidth limit or Fixed bandwidth limit, that manual override will be used until you go back to your schedule by selecting Other Job Options, Set Bandwidth, Scheduled bandwidth limit. For example, if your job is configured to use a daytime limit, you would be limited during the day, but not at night. But if you override that, your override setting will continue both day and night, until you go back to your schedule. See the Managing and controlling jobs section for your job type for more information on the Other Job Options.

     

    Scripts

    

    You can customize mirroring by running scripts on the target at pre-defined points in the mirroring process. Scripts may contain any valid Windows command, executable, or batch file. The scripts are processed using the same account running the Double-Take service, unless you have identified a specific account through the server's properties. There are three types of mirroring scripts.

    • Mirror Start—This script starts when the target receives the first mirror operation. In the case of a difference mirror, this may be a long time after the mirror is started because the script does not start until the first different data is received on the target. If the data is synchronized and a difference mirror finds nothing to mirror, the script will not be executed. Specify the full path and name of the Script file.
    • Mirror Complete—This script starts when a mirror is completed. Because the mirror statistics may indicate a mirror is at 99-100% when it is actually still processing (for example, if files were added after the job size was calculated, if there are alternate data streams, and so on), the script will not start until all of the mirror data has been completely processed on the target. Specify the full path and name of the Script file.
    • Mirror Stop—This script starts when a mirror is stopped, which may be caused by an auto-disconnect occurring while a mirror is running, the service is shutdown while a mirror is running, or if you stop a mirror manually. Specify the full path and name of the Script file.
    • Arguments—Specify a comma-separated list of valid arguments required to execute the script.
    • Allow script to interact with desktop—Enable this option if you want the script processing to be displayed on the screen. Otherwise, the script will execute silently in the background.
    • Delay until script completes—Enable this option if you want to delay the mirroring process until the associated script has completed. If you select this option, make sure your script handles errors, otherwise the mirroring process may never complete if the process is waiting on a script that cannot complete.
    • Test—You can test your script manually by clicking Test. Your script will be executed if you test it. If necessary, manually undo any changes that you do not want on your target after testing the script.

    Mirror scripts are dependent on the target and the Target Path Mappings specified under the Network Route & Folder Selection section. If you establish mirroring scripts for one job and then establish additional jobs to the same target using the same target path mapping, the mirroring scripts will automatically be applied to those subsequent jobs. If you select a different target path mapping, the mirroring scripts will have to be reconfigured for the new job(s).

     

11. Click Next to continue.

12. Double-Take validates that your source and target are compatible. The Summary page displays your options and validation items.

    Errors are designated by a white X inside a red circle. Warnings are designated by a black exclamation point (!) inside a yellow triangle. A successful validation is designated by a white checkmark inside a green circle. You can sort the list by the icon to see errors, warnings, or successful validations together. Click on any of the validation items to see details. You must correct any errors before you can enable your migration. Depending on the error, you may be able to click Fix or Fix All and let Double-Take correct the problem for you. For those errors that Double-Take cannot correct automatically, you will need to modify the source or target to correct the error, or you can select a different target. You must revalidate the selected servers, by clicking Recheck, until the validation check passes without errors.

    Before a job is created, the results of the validation checks are logged to the Double-Take Management Service log on the target.

13. Once your servers have passed validation and you are ready to begin migration, click Finish, and you will automatically be taken to the Manage Jobs page.

Related Topics