Manage metadata changes
Manage how metadata changes are detected by selecting a preferred operation mode.
| Mode | Description |
|---|---|
| Listening (Default) | Listen for changes in real time if supported by your source environment. |
| Scanning | Periodically scan source metadata for changes. |
If your source environment is not configured to use Listeners, LiveData Migrator for Azure must use Scanning as the preferred operation mode.
If your source environment version isn't supported for Hive Migrator Listening mode, configure your source metastore agent to use Scanning as the preferred operation mode.
Configure your source metastore agent to use Scanning as the preferred operation mode if your source environment generates low or insufficient volumes of notifications from the events stream.
Listening mode requirements
Listening mode is supported for HDP 3.1.5 and CDP 7.1.x. See HVM listener event type limitations for more information. Users for any Hadoop version other than HDP 3.1.5 or CDP 7.1.x must select Scanning mode. For information on other Hadoop versions, contact support.
To enable Listening mode, you must have:
- A supported version of Hadoop. See HVM listener event type limitations for more information.
- Listeners enabled on your cluster.
Change operation mode with the Azure Portal
- From Overview, select Preferred Metadata Agent Mode.
- Select either LISTENING or SCANNING. Then Submit to make the change.
- After the change has been made successfully, choose Refresh to view the current agent mode under Metadata Agent Mode.
Change operation mode with the CLI
Change the agent operation mode using the set-meta-agent-mode command.
az livedata migrator set-meta-agent-mode -g MyResourceGroup --migrator-name migrator --meta-agent-mode SCANNING