Version: 3.2 (latest)

Manage metadata migrations

Manage your metadata migrations with Data Migrator using either the UI or CLI.

Manage metadata migrations with the UI

The Dashboard displays an overview of metadata migrations and their status, showing what metadata has been transferred and added since the migration started.

For an overview of the progress and status of individual metadata migrations, go to the Metadata Migrations panel, and search for or filter migrations by migration name.

Status

Select a migration from the Dashboard, Metadata Migrations panel to view its current state, to pause, stop, reset, resume, or delete a migration and view objects migrated information.

note

The object counts displayed on the Metadata Migration Status page show the number of actions taken on the target by Hive Migrator. This includes: creation of databases, tables, views and partitions; changes to write ids and responses to events received from Hive on the source.

Pause a metadata migration

When you start a metadata migration, you can select Pause to suspend transferring metadata.

You can resume a metadata migration that is paused.

Stop a metadata migration

Once a metadata migration has started, you can select Stop to suspend transferring metadata.

You can resume a metadata migration that is stopped.

Reset a metadata migration

After stopping a metadata migration, select Reset to set it to it's origional state before it was started.

You can then start the metadata migration after reset.

Resume a metadata migration

note

See Manage metadata changes for more information on Listening mode.

Resume a paused metadata migration

You can select Resume on a paused migration. If Listening mode is enabled, the migration continues to process the events provided by the listener. If listeners aren't configured, the migration restarts scanning for changes.

Resume a stopped metadata migration

You can select Resume on a stopped migration. If Listening mode is enabled, the migration scans once for changes before continuing to process the events provided by the listener. If listeners aren't configured, the migration restarts scanning for changes.

Delete a metadata migration

note

You must stop or pause a metadata migration before you can delete it.

To delete a metadata migration:

Select the metadata migration from your Metadata Migrations panel.
On the Migration Status page, select Stop.
Select Delete.

Bulk actions

You can apply Resume, Start, Reset, and Stop actions to multiple metadata migrations at once with the UI. See Bulk actions for more details.

Settings

Select a migration from the Dashboard, Metadata Migrations panel then select Settings to see additional configuration information.

Assign management group

To assign a migration group to a metadata migration:

From the Dashboard, select a metadata migration.
Select Settings.
Under Management Group, select a management group.
Select Submit to apply the change.

See Migration Managment for information on the use of management groups and how to delegate migration management.

Override Global Batch Size

If the batch size for the migration needs to be updated or the global batch size needs to be overridden:

Check the Override Global Batch Size box.
Provide the Custom batch size value.
Click Submit. The new value will take effect on the next scan.

It is recommended to adjust this value only when directed by Cirata support. See Migration batch size for more information on the configuration.