Release Notes

Release 2.12.4 Build 2457

15 February 2019

{productname} 2.12.4 is a minor release that includes new features, issue resolutions, platform support, performance, and usability improvements. These release notes include details on the specific improvements and enhancements to the product and should be read in conjunction with the product documentation.

Installation

The release can be installed with updates of the IHC server RPM, the Fusion server RPM and the client stack or package. e.g. The following packages should be updated for HDP 2.6.5:

fusion-hcfs-hdp-2.6.5-ihc-server-2.12.4.3.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.5-server-2.12.4.3.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.5-2.12.4.3.stack.tar.gz

Please contact {orgname} support for help with this process, and find detailed installation instructions in the installation section.

Highlighted New Features

This release includes the following major new features.

WD-FUI-7413 - Installer support of ADLS Gen2

Installer support is provided for Azure Data Lake Storage Gen2.

WD-FUS-5929 - Per-zone username translation

The username translation feature now allows mappings to be defined based on the name of the originating zone and the username, rather than just the username.

New Platform Support

{productname} has added additional support for the following new platforms since version 2.12.2:

  • CDH 5.16

Available Packages

This release of {productname} supports the following versions of Hadoop:

  • ASF Apache Hadoop 2.5.0 - 2.7.0

  • CDH 5.4.0 - CDH 5.16.1

  • HDP 2.1.0 - HDP 2.6.5

  • MapR 5.0.0 - MapR 5.2.0

  • IOP (IBM BigInsights) 4.0 - 4.2.5

The trial download includes the installation packages for CDH and HDP distributions only.

System Requirements

Before installing, ensure that your systems, software, and hardware meet the requirements found in the Pre-requisites Checklist.

Certified Third-Party Components

WANdisco certifies the interoperability of Fusion with a wide variety of systems, including Hadoop distributions, object storage platforms, cloud environments, and applications.

  • Amazon S3

  • Amazon EMR 4.0 - 5.4

  • Ambari 1.6, 1.7, 2.0, 2.1

  • CDH 5.4 - 5.16

  • EMC Isilon 7.2, 8.0

  • Google Cloud Storage

  • Google Cloud Dataproc

  • HDP 2.1.0 - 2.6.5

  • IBM BI 2.1.2 - 4.2.5

  • MapR M4.0.1 - M5.2.0

  • Microsoft Azure Blob Storage

  • Microsoft Azure Data Lake Store Gen1 and Gen2

  • Microsoft Azure HDInsights 3.2 - 3.6

  • MySQL, PostgreSQL (Hive Metastore)

  • Oracle BDA

Client Applications Supported

{productname} is architected for maximum compatibility and interoperability with applications that use standard Hadoop File System APIs. All applications that use the standard Hadoop Distributed File System API or any Hadoop-Compatible File System API should be interoperable with {productname} and will be treated as supported applications. Additionally, {productname} supports the replication of content with Amazon S3 and S3-compatible objects stores, locally-mounted file systems, and NetApp NFS devices, but does not require or provide application compatibility libraries for these storage services.

Known Issues

{productname} 2.12.4 includes a small set of known issues with workarounds. In each case, resolution for the known issues is underway.

  • {productname} does not support truncate command - WD-FUS-3022

The public boolean truncate(Path f, long newLength) operation in org.apache.hadoop.fs.FileSystem (> 2.7.0) is not yet supported. Files will be truncated only in the cluster where the operation is initiated. Consistency check and make consistent can be used to both detect and resolve any resulting inconsistencies.

  • Non-recursive OnTap make consistent operation works recursively - WD-FUS-3932, WD-FUS-3640

All subdirectories for an OnTap snapdiff make consistent process are made consistent when recursive is set to false.

  • Internal Error on REST API under high load - WD-FUS-6236

Under high load, the Fusion server may respond to otherwise valid requests with 500 HTTP responses. While this will resolve automatically, it may temporarily affect use of the Fusion APIs.

Other Improvements

In addition to the highlighted features listed above, {productname} 2.12.4 includes a small set of other improvements:

  • Corrected implementation of authorization header "Bearer token" - WD-FUI-7439, WD-FUS-6114, IBM-REPL-97

  • Fixed location of GSN key records - WD-FUS-6021

  • IHC "Keepalive" optimization - WD-FUS-6089, WD-FUS-6110

  • Do not restore configuration following client install step - WD-FUI-6264

  • Improve kinit usage during security validation for install - WD-FUI-7028

  • Validate truststore configuration for upgrade - WD-FUI-7207

  • Do not set disable truststore on invalid configuration - WD-FUI-7208

  • Improved SSL settings validation - WD-FUI-7264

  • Correct AWS credential permissions - WD-FUI-7285

  • UI trust store settings for silent installer - WD-FUI-7401

  • V2/V4 authentication option for S3 bucket configuration - WD-FUI-7494

  • Correct superuser password reset process - WD-FUI-7513, WD-FUI-7532

  • Allow non-authenticated email notification delivery - WD-FUI-7588

  • Improve InputStream reliability under load - WD-FUS-5587

  • Improve S3 behavior for make consistent operations - WD-FUS-6002

  • Handle client symbolic links during upgrade - WD-FUS-6023

  • Include custom exclusions in upgrade tooling - WD-FUS-6040

  • Improve resolution of large agreement backlogs - WD-FUS-6049

  • RepairExecutor thread fix - WD-FUS-6088

  • Improved performance under load - WD-FUS-6119

  • Consistency check correction for username translation - WD-FUS-6133

  • S3 V2 authentication for CEPH - WD-FUS-6161

  • Correct list of zones in priority selection - WD-FUS-7039

  • Improved input alignment for backup - WD-FUI-7059

  • Labeling of private bucket - WD-FUI-7106

  • Improved naming for administration role - WD-FUI-7176

  • Improved automation for install in Kerberos-enabled clusters - WD-FUI-7195

  • Improved feedback on truststore state during install - WD-FUI-7209

  • Fix email notification content for license limit - WD-FUI-7225

  • Include all 3rd-party license information in distribution - WD-FUI-7234, WD-FUS-5995

  • Use "Make Consistent" term in interface - WD-FUI-7279, WD-FUI-7280, WD-FUI-7304, WD-FUI-7306, WD-FUI-7307, WD-FUI-7314

  • CDH 5.16 support - WD-FUI-7305, WD-FUS-6115

  • Improve redirect after login - WD-FUI-7387

  • Installer support for ADLS Gen 2 - WD-FUI-7413

  • Update LDAP documentation examples - WD-FUI-7454

  • Correct link to ASF client installers - WD-FUI-7599

  • Per-zone username translation - WD-FUS-5929

  • Prevent race condition for concurrent rename from non-replicated to replicated locations - WD-FUS-6006, WD-FUS-6010

  • Improve thread handling for ADLS storage - WD-FUS-6056

  • Offload thread for GSN storage removal - WD-FUS-6073

  • Improve performance for ADLS storage - WD-FUS-6080, WD-FUS-6086

  • Correct Ranger service availability test - WD-FUS-6094

  • Optimize GSN execution storage for non-HA deployment - WD-FUS-6106

  • Improved threading for S3 storage - WD-FUS-6143

  • Document non-support of deprecated Amabari Slider View - WD-FUS-6194

  • Correct documentation link for GCS installation - WD-FUS-6244

  • Default local zone only selection on rule creation - WD-FUI-7143

Release 2.12.3 Build 2134

19 December 2018

WANdisco Fusion 2.12.3 is a minor release following Fusion 2.12.2, and includes issue resolutions, performance, and usability improvements. These release notes include details on the specific improvements and enhancements to the product and should be read in conjunction with the product documentation.

Warning
 Please be aware that there is a known issue which can stop live replication. A hotfix is available on customer.wandisco.com, please contact WANdisco support for information.

Installation

The release can be installed with updates of the IHC server RPM, the Fusion server RPM and the client stack or package. e.g. The following packages should be updated for HDP 2.6.0:

fusion-hcfs-hdp-2.6.0-ihc-server-2.12.3.3.el6-3146.noarch.rpm
fusion-hcfs-hdp-2.6.0-server-2.12.3.3.el6-3146.noarch.rpm
fusion-hcfs-hdp-2.6.0-2.12.3.3.stack.tar.gz

Please contact {orgname} support for help with this process, and find detailed installation instructions in the installation section.

Highlighted Improvements

Oracle OOS

Fusion 2.12.3 improves support for S3 compatible storage APIs, and specifically Oracle Object Stores.

Available Packages

This release of WANdisco Fusion supports the following versions of Hadoop:

  • ASF Apache Hadoop 2.5.0 - 2.7.0

  • CDH 5.5.x - CDH 5.15.x

  • HDP 2.1.0 - HDP 2.6.5

  • MapR 5.0.0 - MapR 5.2.0

  • IOP (IBM BigInsights) 4.2.5

The trial download includes the installation packages for CDH and HDP distributions only.

System Requirements

Before installing, ensure that your systems, software, and hardware meet the requirements found in the Pre-requisites Checklist.

Certified Third-Party Components

WANdisco certifies the interoperability of Fusion with a wide variety of systems, including Hadoop distributions, object storage platforms, cloud environments, and applications.

  • Amazon S3

  • Amazon EMR 4.0 - 5.4

  • Ambari 1.6, 1.7, 2.0, 2.1

  • CDH 5.5 - 5.15

  • EMC Isilon 7.2, 8.0

  • Google Cloud Storage

  • Google Cloud Dataproc

  • HDP 2.1.0 - 2.6.5

  • IBM BI 2.1.2 - 4.2.5

  • MapR M4.0.1 - M5.2.0

  • Microsoft Azure Blob Storage

  • Microsoft Azure Data Lake Store

  • Microsoft Azure HDInsights 3.2 - 3.6

  • MySQL, PostgreSQL (Hive Metastore)

  • Oracle BDA

Client Applications Supported

WANdisco Fusion is architected for maximum compatibility and interoperability with applications that use standard Hadoop File System APIs. All applications that use the standard Hadoop Distributed File System API or any Hadoop-Compatible File System API should be interoperable with {productname}, and will be treated as supported applications. Additionally, Fusion supports the replication of content with Amazon S3 and S3-compatible objects stores, locally-mounted file systems, and NetApp NFS devices, but does not require or provide application compatibility libraries for these storage services.

Known Issues

Fusion 2.12.3 includes a small set of known issues with workarounds. In each case, resolution for the known issues is underway.

  • Fusion does not support truncate command - WD-FUS-3022
    The public boolean truncate(Path f, long newLength) operation in org.apache.hadoop.fs.FileSystem (> 2.7.0) is not yet supported. Files will be truncated only in the cluster where the operation is initiated. Consistency check and repair can be used to both detect and resolve any resulting inconsistencies.

  • Non-recursive OnTap repair repairs recursively - WD-FUS-3932, WD-FUS-3640
    All subdirectories for an OnTap snapdiff repair are repaired when recursive it set to false.

  • NOW FIXED: Potential race condition if new client instance fires multiple requests from a large number of threads in parallel in HA environment, which could result in client-side out of memory error - WD-FUS-5903

  • Fusion client deadlocks under high concurrent load with multiple writers in the zone - WD-FUS-5944
    We observed that the Fusion client can deadlock when running a high number of concurrent requests split between several replicated directories and split equally between multiple Fusion servers as writers in the zone.

  • Fusion UI Server does not set the UI SSL Trust store correctly - WD-FUI-7207
    While SSL can be enabled for the Fusion UI Server, it will trust any certificate and is therefore exposed to man-in-the-middle attacks. This does not affect the Fusion Server responsible for replication.

  • Fusion may experience some performance degradation under very high load with multiple replication rules WD-FUS-5839.

  • In rare cases where {fusion} uses multiple threads to create and move a single file to different locations, you will need to use the Repair tool in order to make the file consistent on all zones. - WD-FUS-6010.

Other Improvements

In addition to the highlighted features listed above, {productname} 2.12.3 includes a small set of other improvements to {productname} 2.12.2:

  • Using the silent installer to install Fusion is more resilient when adding to an existing zone - WD-FUI-7178

  • Fusion installation now knows to ignore yum repos which become unavailable WD-FUI-7142

  • More information is provided regarding what needs to be included in SSL trust stores for a successful installation WD-FUI-7131

  • We have changed which licenses we include for dependencies, migrating away from LGPL where available WD-FUI-7244 WD-FUI-7221 WD-FUI-7252

Release 2.12.2 Build 1993

1 November 2018

WANdisco Fusion 2.12.2 is a minor release following Fusion 2.12.1, and includes new features, issue resolutions, platform support, performance, and usability improvements. These release notes include details on the specific improvements and enhancements to the product and should be read in conjunction with the product documentation.

Warning
 Please be aware that there is a known issue which can stop live replication. A hotfix is available on customer.wandisco.com, please contact WANdisco support for information.

Installation

The release can be installed with updates of the IHC server RPM, the Fusion server RPM and the client stack or package. e.g. The following packages should be updated for HDP 2.6.0:

fusion-hcfs-hdp-2.6.0-ihc-server-2.12.2.4.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-server-2.12.2.4.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-2.12.2.4.stack.tar.gz

Please contact {orgname} support for help with this process, and find detailed installation instructions in the installation section.

Highlighted New Features

This release includes the following major new features.

Fusion marker files

Fusion 2.12.2 adds a feature to allow applications to use a special marker directory to signal across clusters that a collection of files are available in full to a non-originating zone, including their content. For more information see Marker Files.

Highlighted Improvements

WD-FUI-6853 - Installer support of HDP 2.6.5

Installer support is provided for Hortonworks Data Platform 2.6.5.

WD-FUI-6557 - Installer support of CDH 5.15

Installer support is provided for Cloudera 5.15.

New Platform Support

{productname} has added additional support for the following new platforms since Fusion 2.12.1:

  • Alibaba Cloud

Available Packages

This release of WANdisco Fusion supports the following versions of Hadoop:

  • ASF Apache Hadoop 2.5.0 - 2.7.0

  • CDH 5.5.x - CDH 5.15.x

  • HDP 2.1.0 - HDP 2.6.5

  • MapR 5.0.0 - MapR 5.2.0

  • IOP (IBM BigInsights) 4.2.5

The trial download includes the installation packages for CDH and HDP distributions only.

System Requirements

Before installing, ensure that your systems, software, and hardware meet the requirements found in the Pre-requisites Checklist.

Certified Third-Party Components

WANdisco certifies the interoperability of Fusion with a wide variety of systems, including Hadoop distributions, object storage platforms, cloud environments, and applications.

  • Amazon S3

  • Amazon EMR 4.0 - 5.4

  • Ambari 1.6, 1.7, 2.0, 2.1

  • CDH 5.5 - 5.15

  • EMC Isilon 7.2, 8.0

  • Google Cloud Storage

  • Google Cloud Dataproc

  • HDP 2.1.0 - 2.6.5

  • IBM BI 2.1.2 - 4.2.5

  • MapR M4.0.1 - M5.2.0

  • Microsoft Azure Blob Storage

  • Microsoft Azure Data Lake Store

  • Microsoft Azure HDInsights 3.2 - 3.6

  • MySQL, PostgreSQL (Hive Metastore)

  • Oracle BDA

Client Applications Supported

WANdisco Fusion is architected for maximum compatibility and interoperability with applications that use standard Hadoop File System APIs. All applications that use the standard Hadoop Distributed File System API or any Hadoop-Compatible File System API should be interoperable with {productname}, and will be treated as supported applications. Additionally, Fusion supports the replication of content with Amazon S3 and S3-compatible objects stores, locally-mounted file systems, and NetApp NFS devices, but does not require or provide application compatibility libraries for these storage services.

Known Issues

Fusion 2.12.2 includes a small set of known issues with workarounds. In each case, resolution for the known issues is underway.

  • Fusion does not support truncate command - WD-FUS-3022

The public boolean truncate(Path f, long newLength) operation in org.apache.hadoop.fs.FileSystem (> 2.7.0) is not yet supported. Files will be truncated only in the cluster where the operation is initiated. Consistency check and repair can be used to both detect and resolve any resulting inconsistencies.

  • Non-recursive OnTap repair repairs recursively - WD-FUS-3932, WD-FUS-3640

All subdirectories for an OnTap snapdiff repair are repaired when recursive it set to false.

  • Potential race condition if new client instance fires multiple requests from a large number of threads in parallel in HA environment, which could result in client-side out of memory error - WD-FUS-5903

  • Fusion stops live replication when a file us moved into a replicated directory - WD-FUS-6004

When a file from a non-replicated directory is moved into a replicated directory, this can cause Fusion to stop from progressing with live replication. A hotfix is available on customer.wandisco.com, and this issue is resolved in Fusion 2.12.3.

Resolved Known Issues

Fusion 2.12.2 resolves one prior known issue:

  • Recursive parent directory creation with exclusions - WD-FUS-4847

Other Improvements

In addition to the highlighted features listed above, {productname} 2.12.2 includes a small set of other improvements to {productname} 2.12.1:

  • Honor bandwidth policy for unidirectional transfers - WD-FUS-5902, WD-FUS-5888

  • IHC configuration improvements - WD-FUS-5891

  • Improve undirectional connection management - WD-FUS-5889

  • Improve ADLS behavior for delete and rename operations - WD-FUS-5885

  • Ambari stack deployment improvement - WD-FUS-5881, WD-FUS-4083, WD-FUI-6595

  • Repair reporting improvement - WD-FUS-5880

  • Documentation improvement for HDFS impersonation - WD-FUS-5864

  • Documentation improvement for TCP port allocations - WD-FUS-5853

  • Improve recovery from failed NameNode - WD-FUS-5834

  • Improve safety of replication rule creation - WD-FUS-5821, WD-FUS-5772, WD-FUS-5738

  • Allow explicit execution control by plugins - WD-FUS-5788

  • Correct rename operations on WASB - WD-FUS-5768

  • Correct bypass-utils script for CDH clusters - WD-FUS-5762

  • Non-blocking repair correction for directory metadata - WD-FUS-5760

  • Allow Fusion client deployment without HDFS client - WD-FUS-5756, ??? WD-FUS-5303

  • Do not override blocking repair selection - WD-FUS-5747

  • Prevent task hang on replication rule removal - WD-FUS-5738

  • Eliminate potential sideline condition - WD-FUS-5723

  • Remove support for CDH 5.4.0 and CentOS 5 - WD-FUS-5668, WD-FUI-6919

  • Correct repair option to replace files - WD-FUS-5659

  • Remove duplicate symbolic links for client libraries - WD-FUS-5612

  • Improved initial writer allocation for new replication rules - WD-FUS-5597

  • Prevent server panic on rapid replication rule creation - WD-FUS-5585, WD-DCO-784

  • Always include username translation in repair - WD-FUS-5570

  • Validate compatibility with Alibaba EMR NativeOssFilesystem - WD-FUS-5567

  • Improve IHC retry logic - WD-FUS-5522

  • Fusion marker files - WD-FUS-5450

  • Improve retry handling for truncated files - WD-FUS-5408

  • Correct calculation of complete time for file transfer - WD-FUS-5372

  • Core Alibaba EMR 3.10.1 support - WD-FUS-5364, WD-FUI-6829

  • Smaller Fusion stack - WD-FUS-4083

  • Document how to change login name of the super user - WD-FUI-7101

  • Correct highlight of Step 2 during install - WD-FUI-7085

  • Improve documentation on stack deployment - WD-FUI-7058

  • Dcoument repair cancellation - WD-FUI-7043

  • Improve Ambari stack deployment response to deploy errors - WD-FUI-7029

  • Display plugin status on dashboard - WD-FUI-6997, WD-FUI-6958

  • Reduce default log retention time and log size settings - WD-FUI-6953

  • Improve email notification content for license notifications - WD-FUI-6908

  • Remove install dependency on unzip - WD-FUI-6869

  • Default transfer.chunk.size to 32768 - WD-FUI-6863

  • Installer support of HDP 2.6.5 - WD-FUI-6853, WD-FUI-6991, WD-FUI-7010

  • Resolve missing translation strings - WD-FUI-6810, WD-FUI-6806, WD-FUI-6798, WD-FUI-6797, WD-FUI-6793, WD-FUI-6791, WD-FUI-6786, WD-FUI-6779, WD-FUI-6772, WD-FUI-6768, WD-FUI-6766, WD-FUI-6706

  • Fix typo in confirmation of networking settings change - WD-FUI-6803

  • Improve setting page for Kerberos - WD-FUI-6765

  • Provide message when new plugin detected - WD-FUI-6763

  • Make repair history visible - WD-FUI-6711, WD-FUI-6638

  • Correct replication rules filter handling - WD-FUI-6705

  • Improve page number handling - WD-FUI-6692

  • Improve silent installation for ADLS - WD-FUI-6660, WD-FUI-6654

  • Correct i18n sanitization strategy - WD-FUI-6640, WD-FUI-6848

  • Set UI server location in client stack configuration - WD-FUI-6595

  • Installer support of CDH 5.15 - WD-FUI-6557

  • Improve error handling for memory settings from property file - WD-FUI-6489

  • Validate swift.segment.size type in silent installation - WD-FUI-6218

  • Improve tooltip behavior for consistency check - WD-FUI-6125

  • Display error message for invalid push threshold - WD-FUI-5976

  • Guard against invalid port values - WD-FUI-5958

  • Require Key Alias when HTTPS is selected - WD-FUI-5935

  • Improve node identity display - WD-FUI-5847

  • Improve error message for invalid replication exchange directory - WD-FUI-5824

  • Correct pagination with filters - WD-FUI-5808

  • Consolidate error message for incorrect login credentials - WD-FUI-5778

  • Eliminate TransferData failure entries in log - WD-FUI-5752

  • Improve UI Server HTTP client SSL trust handling - WD-FUI-5727

  • Correct error message for client download with incorrect credentials - WD-FUI-5657

Release 2.12.1 Build 1740

14 September 2018

WANdisco Fusion 2.12.1.8 is an update to version 2.12.1 that addresses a small number of minor issues. We advise all customers using WANdisco Fusion to apply this minor update to their environment.

Warning
 Please be aware that there is a known issue which can stop live replication. A hotfix is available on customer.wandisco.com, please contact WANdisco support for information.

Getting Installed

The release can be installed with updates of the IHC server RPM, the Fusion server RPM and the client stack or package. e.g. The following packages should be updated for HDP 2.6.0:

fusion-hcfs-hdp-2.6.0-ihc-server-2.12.1.8.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-server-2.12.1.8.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-2.12.1.8.stack.tar.gz

Please contact WANdisco support for help with this process, and find detailed installation instructions in the user guide at http://docs.wandisco.com/bigdata/wdfusion/2.12/index.html#install

Highlighted New Features

This release includes the following major new feature.

Fusion marker files

Applications can now use Fusion marker files to signal across clusters that files are available in full.

Available Packages

This release of WANdisco Fusion supports the following versions of Hadoop:

  • ASF Apache Hadoop 2.5.0 - 2.7.0

  • CDH 5.4.x - CDH 5.15.x

  • HDP 2.1.0 - HDP 2.6.5

  • MapR 5.0.0 - MapR 5.2.0

  • IOP (IBM BigInsights) 4.2.5

Tip
 Erratum: Support for HDP 2.6.5 and CDH 5.15 does not include the install-time specification of those versions, which was missed in the release packaging of {productname} 2.12.1. While an install should be able to be completed successfully with those versions, complete packaging for them will be provided with a minor release.

The trial download includes the installation packages for CDH and HDP distributions only.

System Requirements

Before installing, ensure that your systems, software and hardware meet the requirements found in our online user guide at http://docs.wandisco.com/bigdata/wdfusion/2.12/index.html#_prerequisites_checklist

Certified Third-Party Components

WANdisco certifies the interoperability of Fusion with a wide variety of systems, including Hadoop distributions, object storage platforms, cloud environments, and applications.

  • Amazon S3

  • Amazon EMR 4.0 - 5.4

  • Ambari 1.6, 1.7, 2.0, 2.1

  • CDH 5.4 - 5.14

  • EMC Isilon 7.2, 8.0

  • Google Cloud Storage

  • Google Cloud Dataproc

  • HDP 2.1.0 - 2.6.4

  • IBM BI 2.1.2 - 4.2.5

  • MapR M4.0.1 - M5.2.0

  • Microsoft Azure Blob Storage

  • Microsoft Azure HDInsight 3.6

  • MySQL, PostgreSQL (Hive Metastore)

  • Oracle BDA

Client Applications Supported

WANdisco Fusion is architected for maximum compatibility and interoperability with applications that use standard Hadoop File System APIs. All applications that use the standard Hadoop Distributed File System API or any Hadoop-Compatible File System API should be interoperable with WANdisco Fusion, and will be treated as supported applications. Additionally, Fusion supports the replication of content with Amazon S3 and S3-compatible objects stores, locally-mounted file systems, and NetApp NFS devices, but does not require or provide application compatibility libraries for these storage services.

Known Issues

Fusion 2.12.1 includes a small set of known issues with workarounds. In each case, resolution for the known issues is underway.

  • Fusion does not support truncate command - WD-FUS-3022

The public boolean truncate(Path f, long newLength) operation in org.apache.hadoop.fs.FileSystem (> 2.7.0) is not yet supported. Files will be truncated only in the cluster where the operation is initiated. Consistency check and repair can be used to both detect and resolve any resulting inconsistencies.

When an exclusion rule prevents the replication of specific files, applications that perform a mkdir() operation that includes the creation of parent directories will not create those parent directories. This may be an unexpected outcome from the definition of that exclusion rule.

  • Non-recursive OnTap repair repairs recursively - WD-FUS-3932, WD-FUS-3640

All subdirectories for an OnTap snapdiff repair are repaired when recursive it set to false.

  • Fusion stops live replication when a file us moved into a replicated directory - WD-FUS-6004

When a file from a non-replicated directory is moved into a replicated directory, this can cause Fusion to stop from progressing with live replication. A hotfix is available on customer.wandisco.com, and this issue is resolved in Fusion 2.12.3.

Other Improvements

  • Prevented PANIC when when replicated more then 200 folders. WD-FUS-5585

  • Expanded IHC configuration options to increase the reliability of repairs. WD-FUS-5728

  • Append command can now be used if using ADLS. WD-FUS-5729

  • Addresses issue with repairing directory permissions during non-blocking repairs WD-FUS-5760

  • Include additional information for debugging on Azure environments WD-FUS-5764

  • File Trees now display replication rules with non US-ASCII names. WD-FUI-6856, WD-FUI-6859

Release 2.12.1 Build 1640

09 August 2018

WANdisco Fusion 2.12.1.6 is an update to version 2.12.1 that addresses a small number of minor issues. We advise all customers using WANdisco Fusion to apply this minor update to their environment.

Warning
 Please be aware that there is a known issue which can stop live replication. A hotfix is available on customer.wandisco.com, please contact WANdisco support for information.

Installation

The release can be installed with updates of the IHC server RPM, the Fusion server RPM and the client stack or package. e.g. The following packages should be updated for HDP 2.6.0:

fusion-hcfs-hdp-2.6.0-ihc-server-2.12.1.6.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-server-2.12.1.6.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-2.12.1.6.stack.tar.gz

Please contact WANdisco support for help with this process, and find detailed installation instructions in the user guide at http://docs.wandisco.com/bigdata/wdfusion/2.12/index.html#install

Highlighted New Features

This release includes the following major new features.

Allow zones to ignore requests

Fusion 2.12.1 has added a feature to allow a zone to ignore agreements that have originated in other zones. This provides added flexibility to limit unnecessary replication traffic for content. Please refer to http://docs.wandisco.com/bigdata/wdfusion/2.12/#_ignorezones for full information on how to use this feature.

New Platform Support

WANdisco Fusion has added support for the following new platforms since Fusion 2.12.0:

  • Alibaba Cloud

Available Packages

This release of WANdisco Fusion supports the following versions of Hadoop:

  • ASF Apache Hadoop 2.5.0 - 2.7.0

  • CDH 5.4.0 - CDH 5.15.0

  • HDP 2.1.0 - HDP 2.6.5

  • MapR 5.0.0 - MapR 5.2.0

  • IOP (IBM BigInsights) 4.2.5

Tip
 Erratum: Support for HDP 2.6.5 and CDH 5.15 does not include the install-time specification of those versions, which was missed in the release packaging of {productname} 2.12.1. While an install should be able to be completed successfully with those versions, complete packaging for them will be provided with a minor release.

The trial download includes the installation packages for CDH and HDP distributions only.

System Requirements

Before installing, ensure that your systems, software and hardware meet the requirements found in our online user guide at http://docs.wandisco.com/bigdata/wdfusion/2.12/index.html#_prerequisites_checklist

Certified Third-Party Components

WANdisco certifies the interoperability of Fusion with a wide variety of systems, including Hadoop distributions, object storage platforms, cloud environments, and applications.

  • Amazon S3

  • Amazon EMR 4.0 - 5.4

  • Ambari 1.6, 1.7, 2.0, 2.1

  • CDH 5.4 - 5.14

  • EMC Isilon 7.2, 8.0

  • Google Cloud Storage

  • Google Cloud Dataproc

  • HDP 2.1.0 - 2.6.4

  • IBM BI 2.1.2 - 4.2.5

  • MapR M4.0.1 - M5.2.0

  • Microsoft Azure Blob Storage

  • Microsoft Azure HDInsight 3.6

  • MySQL, PostgreSQL (Hive Metastore)

  • Oracle BDA

Client Applications Supported

WANdisco Fusion is architected for maximum compatibility and interoperability with applications that use standard Hadoop File System APIs. All applications that use the standard Hadoop Distributed File System API or any Hadoop-Compatible File System API should be interoperable with WANdisco Fusion, and will be treated as supported applications. Additionally, Fusion supports the replication of content with Amazon S3 and S3-compatible objects stores, locally-mounted file systems, and NetApp NFS devices, but does not require or provide application compatibility libraries for these storage services.

Known Issues

Fusion 2.12.1 includes a small set of known issues with workarounds. In each case, resolution for the known issues is underway.

  • Fusion does not support truncate command - WD-FUS-3022

The public boolean truncate(Path f, long newLength) operation in org.apache.hadoop.fs.FileSystem (> 2.7.0) is not yet supported. Files will be truncated only in the cluster where the operation is initiated. Consistency check and repair can be used to both detect and resolve any resulting inconsistencies.

When an exclusion rule prevents the replication of specific files, applications that perform a mkdir() operation that includes the creation of parent directories will not create those parent directories. This may be an unexpected outcome from the definition of that exclusion rule.

  • Non-recursive OnTap repair repairs recursively - WD-FUS-3932, WD-FUS-3640

All subdirectories for an OnTap snapdiff repair are repaired when recursive it set to false.

  • Fusion stops live replication when a file us moved into a replicated directory - WD-FUS-6004

When a file from a non-replicated directory is moved into a replicated directory, this can cause Fusion to stop from progressing with live replication. A hotfix is available on customer.wandisco.com, and this issue is resolved in Fusion 2.12.3.

Other Improvements

  • Fixed a number of UI translation error that appeared in HDFS deployment. WD-FUI-6810

  • Repair tool’s replace option now sets ownership properly. WD-FUS-5659

  • Username translation on Repair, now occurs correctly. WD-FUS-5570

Release 2.12.1 Build 1612

30 July 2018

WANdisco Fusion 2.12.1 is a minor release following Fusion 2.12, and includes new features, issue resolutions, platform support, performance and usability improvements. These release notes include details on the specific improvements and enhancements to the product and should be read in conjunction with the product documentation.

Warning
 Please be aware that there is a known issue which can stop live replication. A hotfix is available on customer.wandisco.com, please contact WANdisco support for information.

Installation

The release can be installed with updates of the IHC server RPM, the Fusion server RPM and the client stack or package. e.g. The following packages should be updated for HDP 2.6.0:

fusion-hcfs-hdp-2.6.0-ihc-server-2.12.1.5.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-server-2.12.1.5.el6-xxxx.noarch.rpm
fusion-hcfs-hdp-2.6.0-2.12.1.5.stack.tar.gz

Please contact WANdisco support for help with this process, and find detailed installation instructions in the user guide at http://docs.wandisco.com/bigdata/wdfusion/2.12/index.html#install.

Highlighted New Features

This release includes the following major new features.

Allow zones to ignore requests

Fusion 2.12.1 has added a feature to allow a zone to ignore agreements that have originated in other zones. This provides added flexibility to limit unnecessary replication traffic for content. Please refer to http://docs.wandisco.com/bigdata/wdfusion/2.12/#_ignorezones for full information on how to use this feature.

New Platform Support

WANdisco Fusion has added support for the following new platforms since Fusion 2.12:

  • Alibaba Cloud

Available Packages

This release of WANdisco Fusion supports the following versions of Hadoop:

  • ASF Apache Hadoop 2.5.0 - 2.7.0

  • CDH 5.4.0 - CDH 5.14.0

  • HDP 2.1.0 - HDP 2.6.4

  • MapR 5.0.0 - MapR 5.2.0

  • IOP (IBM BigInsights) 4.2.5

The trial download includes the installation packages for CDH and HDP distributions only.

System Requirements

Before installing, ensure that your systems, software and hardware meet the requirements found in our online user guide at http://docs.wandisco.com/bigdata/wdfusion/2.12/index.html#_prerequisites_checklist

Certified Third-Party Components

WANdisco certifies the interoperability of Fusion with a wide variety of systems, including Hadoop distributions, object storage platforms, cloud environments, and applications.

  • Amazon S3

  • Amazon EMR 4.0 - 5.4

  • Ambari 1.6, 1.7, 2.0, 2.1

  • CDH 5.4 - 5.14

  • EMC Isilon 7.2, 8.0

  • Google Cloud Storage

  • Google Cloud Dataproc

  • HDP 2.1.0 - 2.6.4

  • IBM BI 2.1.2 - 4.2.5

  • MapR M4.0.1 - M5.2.0

  • Microsoft Azure Blob Storage

  • Microsoft Azure HDInsight 3.6

  • MySQL, PostgreSQL (Hive Metastore)

  • Oracle BDA

Client Applications Supported

WANdisco Fusion is architected for maximum compatibility and interoperability with applications that use standard Hadoop File System APIs. All applications that use the standard Hadoop Distributed File System API or any Hadoop-Compatible File System API should be interoperable with WANdisco Fusion, and will be treated as supported applications. Additionally, Fusion supports the replication of content with Amazon S3 and S3-compatible objects stores, locally-mounted file systems, and NetApp NFS devices, but does not require or provide application compatibility libraries for these storage services.

Known Issues

Fusion 2.12.1 includes a small set of known issues with workarounds. In each case, resolution for the known issues is underway.

  • Fusion does not support truncate command - WD-FUS-3022

The public boolean truncate(Path f, long newLength) operation in org.apache.hadoop.fs.FileSystem (> 2.7.0) is not yet supported. Files will be truncated only in the cluster where the operation is initiated. Consistency check and repair can be used to both detect and resolve any resulting inconsistencies.

When an exclusion rule prevents the replication of specific files, applications that perform a mkdir() operation that includes the creation of parent directories will not create those parent directories. This may be an unexpected outcome from the definition of that exclusion rule.

  • Non-recursive OnTap repair repairs recursively - WD-FUS-3932, WD-FUS-3640

All subdirectories for an OnTap snapdiff repair are repaired when recursive it set to false.

  • Fusion stops live replication when a file us moved into a replicated directory - WD-FUS-6004

When a file from a non-replicated directory is moved into a replicated directory, this can cause Fusion to stop from progressing with live replication. A hotfix is available on customer.wandisco.com, and this issue is resolved in Fusion 2.12.3.

Other Improvements

In addition to the highlighted features listed above, Fusion 2.12.1 includes a small set of other improvements to Fusion 2.12:

  • Improved large file replication in Azure - WD-FUS-5437

  • Correct license report generation - WD-FUS-5512

  • Improved repair outcomes for recursive non-blocking repair - WD-FUS-5537

  • Alibaba OSS compatibility improvements - WD-FUS-3954

  • Support for Alibaba OSS authentication - WD-FUS-3898

  • Improved packaging under cluster upgrade - WD-FUS-4165

  • Automate Fusion configuration for Druid - WD-FUS-5339

  • Improved sysinfo in talkbacks - WD-FUS-5445

  • Improved behavior under outage conditions - WD-FUS-5530

  • Ensure commutative behavior of consistency check strategy - WD-FUS-5558

  • Provide type in consistency check task list - WD-FUS-4559

  • Minor improvement to repair efficiency - WD-FUS-5152

  • Improved classpath handling on package upgrade - WD-FUS-5180

  • Ensure ability to run talkback as non-privileged user - WD-FUS-5351

  • Correct race condition in Fusion server startup script - WD-FUS-5413

  • Removal of unnecessary log entries - WD-FUS-5464

  • Correct license report task on MapR 5.2.0 - WD-FUS-5466

  • API on Fusion server to trigger GC - WD-FUS-5472

  • Fixed - information loss when notification buffer fills - WD-FUS-5476, WD-FUS-5532

  • Improved reporting for non-retriable exceptions - WD-FUS-5478

  • Fixed consistency check with Scality - WD-FUS-5487

  • Correction to repair with user translation - WD-FUS-5505

  • Robust multipart upload handling for S3 compatible stores - WD-FUS-5552

  • Avoid NPE on transfer update with replication rule removal - WD-FUS-5556

  • Fix bandwidth calculations - WD-FUS-5563

  • Remove symbolic links on RPM or DEB removal - WD-FUS-5565

  • Correct naming of length indication in IHC logs - WD-FUS-2679

  • Improve receive buffer size matching - WD-FUS-5494

  • Transfer logging cleanup - WD-FUS-5495

  • ReplicatedFC applyUmask allows null permission - WD-FUS-5572

  • Fusion UI authentication with correct Kerberos superuser - WD-FUI-5217

  • i18n locale support for command-line installer - WD-FUI-6599

  • Fixed - Field user.password empty after installation - WD-FUI-6101, WD-FUI-6577

  • Fixed - S3 Installation failure - WD-FUI-6175

  • Improved error message for incorrect login - WD-FUI-6550

  • Fixed - Incorrect localNode API - WD-FUI-6555

  • Fixed - Empty warning message in repair submission - WD-FUI-6561

  • Filter functionality on replication rules page - WD-FUI-6562

  • Alibaba OSS support for UI and silent installer - WD-FUI-6584

  • Alibaba OSS support in packaging and command-line installer - WD-FUI-6585

  • Localization for Simplified Chinese language - WD-FUI-6586

  • Fixed - override of plugin features - WD-FUI-6623

  • Remove LDAP settings for cloud environments - WD-FUI-6639

  • Fixed - Spark service start failure on CDH 5.10, CDH 5.11 - WD-FUI-5466

  • Environment installer page step indication - WD-FUI-5597

  • System status correction for no replication rules - WD-FUI-5473

  • Fixed - display of tooltip on replication rule actions - WD-FUI-5901

  • Fixed - Kerberos validation failure when klist unavailable - WD-FUI-5953

  • Filter for inconsistent status - WD-FUI-6038

  • Preview of LDAP queries - WD-FUI-6188

  • Correct response for authorization restriction - WD-FUI-6390

  • SSL settings validated for LDAP - WD-FUI-6410

  • Correct access to LDAP settings for manager user - WD-FUI-6467

  • Correct error message for port validation - WD-FUI-6490

  • Clarify error message for log update settings - WD-FUI-6492

  • Complete translation of installer node page - WD-FUI-6507

  • Guard against UI server failure during discovery - WD-FUI-6512

  • Fixed - incorrect CC type for trigger blocking check - WD-FUI-6524

  • Silent installer role map load from serialized file - WD-FUI-6546

  • Fixed - undefined error message on confirmation of node stop - WD-FUI-6558

  • Fixed - empty warning during update of local zone network properties - WD-FUI-6565

  • Fixed - typo in UI zone installation - WD-FUI-6566

  • Fixed - empty error message for long values on settings page - WD-FUI-6572

  • Fixed - plugin install permission enforcement - WD-FUI-6579

  • Verification of super user password change - WD-FUI-6590

  • Improved internal validation of local node availability at install - WD-FUI-6592

  • Alignment of server port validation - WD-FUI-6593

  • Fixed - spacing in license expiry message - WD-FUI-6600

  • Translation corrections - WD-FUI-6607, WD-FUI-6636, FUI-6663

  • Indicate local status when stopping local node - WD-FUI-4819

  • Installer typo fix - WD-FUI-6541

  • Status message for file transfer column correction - WD-FUI-6568

  • Fixed - LDAP enabled UI asks for manager credentials - WD-FUI-6574

  • Improve UI layout for Firefox 61 - WD-FUI-6576

  • Bandwidth indicators on dashboard page - WD-FUI-6583

  • Consistent capitalization on button text - WD-FUI-6547

  • Remove AD-specific LDAP defaults - WD-FUI-6549

Release 2.12.0 Build 1539

28 June 2018

WANdisco Fusion 2.12 is a new major release of the Fusion platform, available now from the WANdisco file distribution site. This release includes key new features, platform support, installation, scale, performance and usability improvements.

Warning
 Please be aware that there is a known issue which can stop live replication. A hotfix is available on customer.wandisco.com, please contact WANdisco support for information.

Installation

Find detailed installation instructions in the user guide at {shortname} Installation (On-premises).

Upgrades from Earlier Versions

As a major release, Fusion 2.12 introduces incompatibilities with the network protocols and storage formats used by prior versions. Please contact WANdisco support for information on the upgrade mechanism appropriate for your environment.

Specific new features have been added to this release to allow for minimally-disruptive approaches to upgrading from prior releases. The combination of non-blocking repair (sync) functionality with tooling to capture and reapply deployment configuration can be used to upgrade with minimal user input and minimal disruption to application behavior.

Highlighted New Features

This release includes the following major new features.

Tooling for Major Upgrades

This release introduces a tool that assists in bootstrapping a new Fusion deployment from the configuration and settings of a previous Fusion installation. Use it to capture and store the prior installation’s configuration so that a new deployment can be brought up quickly and automatically.

Non-Blocking Repair

Fusion supports a feature called "Repair", which provides a mechanism to correct inconsistencies between zones by restoring file system metadata and replicating content. Prior versions of Fusion provide this capability by blocking other operations that may be attempted against a location under repair while that task is in process. Fusion 2.12 introduces a non-blocking variant of Repair that can operate without affecting application operation during the task execution.

Non-blocking repair is a variant of regular repair with enhanced concurrency controls to prevent lost updates and file corruption. It performs a best-effort repair of a replicated location, reducing the scope of the locks applied to individual files. During execution of a non-blocking repair, only individual files are locked, rather than the root of the replicated location. This makes non-blocking repair suitable for use during regular application operation against replicated directories.

Other benefits of the non-blocking repair include reduced cluster load, Fusion memory consumption and preventing a surge in resources consumption following repair completion.

Heterogenous Plugins

Deploy more complex Fusion environments where not every Fusion server requires the same set of plugins to be installed. Fusion 2.12 will operate safely under conditions where Fusion servers have different plugins.

Internationalization of User Interface

User-facing information in the Fusion user interface is fully internationalized, allowing future releases to support other locales and present non-US English material, including that requiring double-byte character support.

Authorization Roles for User Interface

The Fusion user interface now allows individual users to be assigned to one of a collection of roles that restrict their capabilities. These roles span:

Read-only users

who have the ability to view all information but make no modifications to system state or behavior,

Content owners

who manage replication rules but do not have the responsibility for the continued health and operation of the Fusion infrastructure, and

Infrastructure users

who are responsible for the health and operation of the Fusion system, but who do not manage the data that it replicates.

User roles can be assigned through an external directory, and will affect the privileges and capabilities available for a given user accessing the user interface. Read more in Roles and permissions.

Highlighted Improvements

WD-FUS-3861 - Per DSM manual fast bypass

Manual fast bypass allows the Fusion client to bypass coordination of operations. Prior releases allowed this to be triggered by the existence of a bypass directory in the location specified by the fusion.replicated.dir.exchange configuration property. Fusion 2.12 extends that feature to allow bypass to affect only individual directories.

Use the /opt/wandisco/fusion/tools/bin/bypass-utils script to manage bypass options:

$ /opt/wandisco/fusion/tools/bin/bypass-utils --help
Initializing Bypass Utility
usage: bypass utility options are:
 -b,--bypass <path>               specify a path to bypass replication.
                                  (Can be used more than once)
 -c,--conf <configuration file>   specify an application configuration
                                  file. (Can be used more than once)
 -h,--help                        show this usage message.
 -r,--replicate <path>            specify a path that should be
                                  replicated. (Can be used more than once)
 -s,--status                      show current paths in bypass.

Known Issues Resolved

Previous known issues that are resolved in this release are:

Recursive parent directory creation with exclusions - WD-FUS-4847

When an exclusion rule prevents the replication of specific files, applications that perform a mkdir() operation than includes the creation of parent directories will not create those parent directories. This may be an unexpected outcome from the definition of that exclusion rule.

This issue is resolved in Fusion 2.12.

Available Packages

This release of WANdisco Fusion supports the following versions of Hadoop:

  • ASF Apache Hadoop 2.5.0 - 2.7.0

  • CDH 5.2.0 - CDH 5.14.0

  • HDP 2.1.0 - HDP 2.6.4

  • MapR 5.0.0 - MapR 5.2.0

  • IOP (IBM BigInsights) 4.2.5

The trial download includes the installation packages for CDH and HDP distributions only.

System Requirements

Before installing, ensure that your systems, software and hardware meet the requirements found in our online user guide at http://docs.wandisco.com/bigdata/wdfusion/2.12.

Certified Third-Party Components

WANdisco certifies the interoperability of Fusion with a wide variety of systems, including Hadoop distributions, object storage platforms, cloud environments, and applications.

  • Amazon S3

  • Amazon EMR 5.3 - 5.4

  • CDH 5.4 - 5.14

  • EMC Isilon 7.2, 8.0

  • Google Cloud Storage

  • Google Cloud Dataproc

  • HDP 2.1.0 - 2.6.4

  • IBM BI 2.1.2 - 4.2.5

  • MapR M4.0.1 - M5.2.0

  • Microsoft Azure Blob Storage

  • Microsoft Azure HDInsight 3.6

  • MySQL, PostgreSQL (Hive Metastore)

  • Oracle BDA

Client Applications Supported

WANdisco Fusion is architected for maximum compatibility and interoperability with applications that use standard Hadoop File System APIs. All applications that use the standard Hadoop Distributed File System API or any Hadoop-Compatible File System API should be interoperable with WANdisco Fusion, and will be treated as supported applications. Additionally, Fusion supports the replication of content with Amazon S3 and S3-compatible objects stores, locally-mounted file systems, and NetApp NFS devices, but does not require or provide application compatibility libraries for these storage services.

Known Issues

Fusion 2.12 includes a small set of known issues with workarounds. In each case, resolution for the known issues is underway.

  • Fusion does not support truncate command - WD-FUS-3022

The public boolean truncate(Path f, long newLength) operation in org.apache.hadoop.fs.FileSystem (> 2.7.0) is not yet supported. Files will be truncated only in the cluster where the operation is initiated. Consistency check and repair can be used to both detect and resolve any resulting inconsistencies.

  • Unexpected things may happen if you restart in the middle of trying to deploy DSMs, leading to a failure to deploy the replicated directory completely on the node being restarted. If it happens, you can remove the replicated directory on the other nodes and then redeploy. - WD-FUS-5597

  • During the rapid creation of large numbers of DSMs, the {shortname} server may fail to start, resulting in a "Received TerminalEvent" PANIC log message. - WD-FUS-5595

  • The creation of large numbers (100s) or replicated folders may cause a node to crash with a "uncommitted transaction" panic message in the logs. The cause is an issue in the underlying coordination engine, where negative acknowledgements can leave a thread-local transaction uncommitted. The issue is automatically fixed with a restart of the crashed node. - WD-FUS-5585

  • Fusion stops live replication when a file us moved into a replicated directory - WD-FUS-6004

When a file from a non-replicated directory is moved into a replicated directory, this can cause Fusion to stop from progressing with live replication. A hotfix is available on customer.wandisco.com, and this issue is resolved in Fusion 2.12.3.

Other Improvements

In addition to the highlighted features listed above, Fusion 2.12 includes a wide set of improvements in performance, functionality, scale, interoperability and general operation.

  • Tooling for major upgades - WD-FUS-1961

  • Non-blocking repair - WD-FUS-3393

  • FIX - Fusion is unable to deserialize transaction - WD-FUS-4217

  • Replication stops if target cluster restarts during copy - WD-FUS-3078

  • Per DSM manual fast bypass - WD-FUS-3861

  • Improved console logging - WD-FUS-3996

  • Persistent execution history - WD-FUS-4582

  • FIX - Ambari HDFS client install does not enforce required order - WD-FUS-4655

  • FIX - Consistency Check results become unavailable after a while - WD-FUS-1216

  • Fusion server is closing channel on namenode exception - WD-FUS-1704

  • Make Repair use RequestWithMetadata - WD-FUS-2452

  • S3 Streamed Uploads - WD-FUS-2843

  • Audit filter should just dump the raw message body - WD-FUS-3076

  • API call to consume XML to create/update replicated path properties - WD-FUS-3323

  • Update FusionAbstractFs to be used in fs.AbstractFileSystem.hdfs.impl - WD-FUS-3399

  • FIX - Shared KMS does not work for metadata driven operations - WD-FUS-3528

  • FIX - DSM handler installation race - WD-FUS-3762

  • FIX - Failed deployment of DSM will block removal - WD-FUS-3781

  • FIX - KMS client failure in destination zone - WD-FUS-3912

  • FIX - Race condition with update of IHC information in PWP and pull of file - WD-FUS-3918

  • FIX - Distribution upgrade triggers yum repository logic - WD-FUS-4186

  • Endpoint to report on CC progress - WD-FUS-3939

  • FIX - Ambari HDFS client install does not enforce required order - WD-FUS-4333

  • Modify consistency check to handle extended file statuses - WD-FUS-4378

  • Modify repair to use consistency check report as input - WD-FUS-4426

  • Provide ability to replicate timestamps - WD-FUS-4531

  • Support EPOLL - WD-FUS-4638

  • FIX - The CC and Repair handling of permissions is inconsistent (S3) - WD-FUS-4640

  • Remove unused/incorrect IhcMetrics.setTransferLength - WD-FUS-4641

  • FUS-3470 API for contents of AgreedProposalExecutor - WD-FUS-4646

  • Consistent URI logging format - WD-FUS-4697

  • FIX - Fusion client reinstall does not occur after hdp upgrade - WD-FUS-4731

  • Enable option for netty logging - WD-FUS-4761

  • FIX - Object store hard coded permissions - WD-FUS-4762

  • Optimize gsn folder cleanup on S3 - WD-FUS-4802

  • Delegate setStoragePolicy APIs to underlying fs - WD-FUS-4825

  • FIX - Not mapped response redirect - WD-FUS-4829

  • FUS-4838 Various tasks were not cleaned after replicated folders were removed. - WD-FUS-4831

  • Last Rule deletion does not work - WD-FUS-4838

  • FIX - Documented recommended memory values need adjustment - WD-FUS-4839

  • Support recursive parent directory creation for exclusions - WD-FUS-4847

  • FIX - OpenSSL memory leak - WD-FUS-4857

  • FIX - Client hangs when first Fusion node is stopped (kill -STOP) - WD-FUS-4898

  • FIX - listExtendedFileStatus in FsStoreProxy default sets includeTopDir true - WD-FUS-4899

  • FIX - Path truncation in fusion-dcone logs - WD-FUS-4917

  • FIX - application.properties type casting logic - WD-FUS-4940

  • Repair of zero length file from EMR/S3 to HDFS overrides default permissions - WD-FUS-4944

  • FIX - Fusion client blocks indefinitely with bypass enabled - WD-FUS-4947

  • FIX - Fusion related files created with 777 permissions in HDFS - WD-FUS-4963

  • Move executed GSN’s to an external location - WD-FUS-4966

  • FIX - Remote zone holds file lease indefinitely if HDFS restarts during a pull - WD-FUS-4996

  • FIX - memory leak inside hflushRecordMap if Exception happens before we mark HFlushRecord as Executed - WD-FUS-4998

  • Delegate getStoragePolicy APIs to underlying fs - WD-FUS-5017

  • Talkback script always prompts for ticket number - WD-FUS-5038

  • Server Scripts should check process, not PID file - WD-FUS-5044

  • FIX - Negative and non-zero values in transfers - WD-FUS-5053

  • Document GSN/Metadata directory configs - WD-FUS-5122

  • Bootstrap replicated directory on first RD rather than on DSM deployment - WD-FUS-5179

  • Improved Fusion server restart time - WD-FUS-5186

  • FIX - Unable to remove replicated paths - WD-FUS-5200

  • Don’t log every inconsistency at INFO level - WD-FUS-5220

  • Raw and metadata pulls should be done as system user of the source zone - WD-FUS-5274

  • FIX - RenameFileToReplicatedRequest failed in pre_rename - WD-FUS-5289

  • Don’t make requests dependent when they are not relevant to a zone - WD-FUS-5291

  • talkback should switch from (deprecated) ifconfig to ip - WD-FUS-3584

  • Add logging in FsMonitor - WD-FUS-3832

  • [Talkback] Clean Up User Queries - WD-FUS-4206

  • totalTransferred in IHC transfers API should be long not double - WD-FUS-4625

  • Move LocalFileSystem client logging to appropriate directories - WD-FUS-4698

  • FIX - Fusion server restart has confusing message if fusion server did not exist - WD-FUS-4962

  • Fix the configure-fusion-server script such that it creates a correct statemachine.xml - WD-FUS-5028

  • FileProxy methods for client handshake should be Unsupported Operation - WD-FUS-5067

  • In server, log which IHC we connected to for a pull - WD-FUS-5091

  • S3Lister should include name in toString and invalid config should log warning - WD-FUS-5083

  • Add IHC connection logging - WD-FUS-5091

  • Remove knox classpath symlinks on uninstall - WD-FUS-5130

  • Map adl:// scheme to org.apache.hadoop.fs.adl.AdlFileSystem - WD-FUS-5154

  • Do not retry malformed setfacl operation in local zone - WD-FUS-5155

  • Bootstrap replicated directory correctly - WD-FUS-5179

  • Azure Data Lake dependencies - WD-FUS-5189

  • Improve data immutability on unsuccessful pull - WD-FUS-5194

  • Correct replicated path removal - WD-FUS-5200

  • Minimize INFO logging of inconsistency - WD-FUS-5220

  • Perform client side ADL checks - WD-FUS-5268

  • Apply system user identify to source zone pulls - WD-FUS-5274

  • Fix execution of operations that rename to replicated location- WD-FUS-5289

  • Remove dependencies for operations that do not affect zone - WD-FUS-5291

  • Client initialization logs client version - WD-FUS-5319

  • Handle client-server credential differences for ADL - WD-FUS-5330

  • Fix IHC history lookup - WD-FUS-5360

  • Improve task deletion - WD-FUS-5374

  • Apply PermGen configuration during installation - WD-FUS-5377

  • Fix stack deployment for HDP 2.6.4 on Ubuntu 16 - WD-FUS-5380

  • Improve handshake error message on failed mkdir/chown - WD-FUS-5390

  • Support arbitrary file system schemes - WD-FUS-5418

  • Improve security checks for ADL - WD-FUS-5419

  • Fix NPE in TransferManager initialization - WD-FUS-5421

  • Internationalization of the user interface - WD-FUI-3216

  • Bypass and replicated exchange settings for HDInsight - WD-FUI-5556

  • FIX - User sometimes unnecessarily logged out with concurrent sessions - WD-FUI-2244

  • Repair from checkpoit UI Server side implementation - WD-FUI-3458

  • Remove disk monitoring from the UI - WD-FUI-4675

  • Non-blocking Repair - WD-FUI-4685

  • Reduce monolthic installer size - WD-FUI-4689

  • FIX - Fusion UI shows 'Unable to locate the result' on replication page in case of network problems - WD-FUI-4876

  • FIX - Cluster graph errors on warning/error states - WD-FUI-5025

  • Remove Summary step from installer - WD-FUI-5596

  • Remove Custom Consistency Check tab - WD-FUI-5765

  • FIX - KMS setting is displayed under kerberos settings - WD-FUI-5013

  • FIX - Console error when typing in RD dir name - WD-FUI-5198

  • External UI links should persist through login page - WD-FUI-5266

  • FIX - GET /api/repair/history?path= returns null value on node repair is initiated from - WD-FUI-5308

  • URI tag on the rules table should not be red - WD-FUI-5536

  • FIX - Oddly highlighted X when opening operations window- WD-FUI-5066

  • Correct MapR client settings in installer - WD-FUI-5097

  • FIX - console error when submitting replicated directory - WD-FUI-5198

  • Persist external UI links through login page - WD-FUI-5266

  • FIX - null value on repair history API - WD-FUI-5308

  • Correct color for URI tag on rules table - WD-FUI-5536

  • Display S3A file system on replicated folder creation - WD-FUI-5551

  • Bypass and replicated directory exchange settings for HD Insight - WD-FUI-5556

  • Remove summary step from installer - WD-FUI-5596

  • Multi-byte character support - WD-FUI-5614

  • Removal of custom consistency check tab - WD-FUI-5765

  • FIX - Hive installer can’t pass KDC credential validation - WD-FUI-5845

  • Remove CLI reference to Fusion server port - WD-FUI-5915

  • Label consistency between installer and settings page - WD-FUI-5990

  • IOP 4.0 support removal - WD-FUI-6003

  • Correct total size of data in folder for S3 - WD-FUI-6042

  • Ubuntu 16 installation - WD-FUI-6250

  • Correct filtering of replication rules - WD-FUI-6252