Test drive LiveData Migrator for Azure

The Test Drive service contains a sample Hadoop environment and all the components necessary to experience LiveData Migrator. Test Drive allows you to sign in to an Azure Test Drive subscription without the need for your own.

The Test Drive subscription comes with the following preconfigured components:

• Resource group
• Storage account
• Container

This Test Drive experience allows you to do the following:

• Deploy and use LiveData Migrator for Azure to demonstrate how you can migrate actively-changing data from a Hadoop cluster to an ADLS Gen2 account.
• Familiarize yourself with LiveData Migrator’s features and native integration into Azure Portal.
• Interact with data from the Hadoop environment and show how easy it is to use the system to effectively migrate your data.

Get started with your Test Drive

1. Go to Azure Marketplace and select Test Drive.

   You'll receive an email in approximately 10 minutes with sign-in credentials.

   

   note

   Test Drive is available for two hours from the time you receive the email with your sign-in credentials. A timer is displayed at the top of your screen.

2. Sign out of your Azure Portal account or open a private or incognito browser window.

3. Go to Azure Portal.

4. Sign in with the Test Drive user name and password provided in the email.

5. Select Yes to stay signed in.

6. Skip the tour of Microsoft Azure by selecting Maybe Later.

Connect to the virtual machine to view data in the Hadoop test cluster

1. In Azure Portal, go to All resources.

   

   note

   If you weren't prompted to use the sign-in credentials and you see a Recent resources section, you're in your own subscription. Sign out or use private browsing.

2. To form a Secure Shell (SSH) connection, select the Virtual Machine (VM).

   

3. Locate and take note of the public IP address.

   

4. Connect to the VM by selecting Connect > SSH.

   

5. Open your terminal, and type and run the following command:

   Example

   ssh -L 8092:localhost:8888 wandisco@<public_ip_address>

6. Enter the password Wandisco123!.

   note

   If you are using Windows, paste text by right-clicking the icon in the top left. Then select Edit, Paste.

   The wandisco@wandisco-ldma prompt appears.

   

   Leave this window open.

Check LiveData Migrator is installed

1. Go to Azure Portal.

2. Select the resource group name, and then select your LiveData Migrator.

   

3. Check the Install State and Meta Install State are both InstalledAndOperational.

   

   note

   If the install state is not InstalledAndOperational, check back in a few minutes. Starting up the cluster and installing LiveData Migrator can take a little over 10 minutes depending on Azure resources.

Connect to Hue to view files in Hadoop

1. Open a new browser tab and go to http://127.0.0.1:8092.

   

2. Enter the following credentials:

   • Username: hdfs
   • Password: hdfs

   The connection is made.

   info

   In Hue, if you get an error that you're no longer connected to the VM through SSH, please SSH in again using your CLI.

3. Select Files from the left pane, and then go up two levels to the root level.

   

4. Drill down into the Demo/1GB folder.

   

5. Take a note of the two data files in Demo/1GB.

Specify the migration target

1. To create the target for your data migration, select Targets.

2. Select Create.

   

3. Enter the following details:

   • Target name
   • Storage account
   • Storage container

4. Select Review + create, and then on the next page, select Create.

   

5. Once completed, select Go to resource to check your target for data migration has been created.

   

6. Check the provisioning state is Succeeded.

   Note the entry for the Storage account/container specifies where your target data will be migrated to.

   

Create the migration

1. Select the resource group.

2. Select the LiveData Migrator resource.

   

3. Select Migrations > Create.

   

4. Enter the following migration details:

   • Enter a migration name.
   • Select the preconfigured target storage.
   • Select the preconfigured path.

   

5. Select Next: Migration Settings.

6. For Automatically Start Migration, select Yes.

7. Select Review + create > Create.

Now your migration is running.

1. Check the migration has been created and is running by selecting Go to resource.

   

2. Check the following details:

   • Provisioning state is Succeeded.
   • Migration status is Live, which means migrations have started.
   • The path is the /demo source folder.

   

Check the initial data migration to ADLS Gen2 storage

1. In the top search bar, search for storage accounts.

   

2. Select your storage account.

3. Select Containers in the left menu.

   

4. Select your container.

   

5. Drill down to /Demo/1GB to check the data migrated.

   

6. Compare with the files in Hue.

Check updates to source data are reflected in the target

To check live changes made to source files in Hue are added to the container, complete the following steps:

1. Add a file to the source location in Hue by opening Hue and selecting Upload.

   

2. Follow prompts to add a file from your computer.

3. Check the file is added.

   

4. Go to your container in Azure Portal and select Refresh.

   The file has been added.

5. Delete a file from the source location in Hue by opening Hue and selecting a file to delete.

6. Select Delete forever and confirm.

   

7. Go to your container in Azure Portal and select Refresh.

   The file has been deleted.

8. Rename a file in the source location by opening Hue and selecting a file to rename.

9. Select Actions > Rename.

   

10. Enter a new name and confirm.

11. Check the file is renamed in Azure Portal.

    

You completed the Test Drive exercises. Your environment will be deleted at the end of the two-hour Test Drive.