Release Notes

WD Fusion 2.8 Build 0028 - 16 June 2016

Available Packages

WD Fusion currently supports the following versions of Hadoop:

  • CDH 5.2.0
  • CDH 5.3.0
  • CDH 5.4.0
  • CDH 5.5.0
  • CDH 5.6.0
  • CDH 5.7.0
  • HDP 2.1.0
  • HDP 2.2.0
  • HDP 2.3.0
  • HDP 2.4.0
  • MAPR 4.0.1 *
  • MAPR 4.0.2 *
  • MAPR 4.1.0 *
  • MAPR 5.0.0 *
  • Pivotal HD 3.0.0 *
  • Pivotal HD 3.4.0 *
  • IOP (BigInsights) 4.0 *
  • IOP (BigInsights) 4.1 *

Available packages
* These HD packages are not included in the trial download but are available for production.

System Requirements

Before you install this software you must ensure that you meet the necessary system, software and hardware requirements for running WD Fusion.
See a full checklist in our online user guide: docs.wandisco.com/bigdata/wdfusion/

Supported Hadoop Packages:

View our list of supported versions of Hadoop: - docs.wandisco.com/bigdata/wdfusion/install.html#supported

Certified Platforms / DBMS & DConE Support:

  • HDP 2.1.2 - 2.4.0
  • Ambari 1.6, 1.7, 2.0, 2.1
  • Pivotal HD 3.0 - 3.4 IBM BI 4.0
  • CDH 5.2 - 5.6.0
  • EMC Isilon 7.2
  • MapR M4.0x, 4.1.0
  • DConE 1.3
  • MySQL (Hive MetaStore)
  • Oracle BDA
  • Amazon EMR 4.0, 4.1, 4.2
  • Google Compute

Client Applications Supported:

  • Hive
  • SparkSQL
  • Impala* Some current limitations - contact WANdisco's solutions team
  • HBase
  • SQOOP
  • Flume
  • Kafka
  • Storm

Installation

You can find detailed instructions on how to get up and running in our online user guide:
- docs.wandisco.com/bigdata/wdfusion/install.html#procedure

Upgrades from an earlier version:

It's essential that you remove previously installed versions of WD Fusion before you complete a new installation.
We have a procedure for upgrading to the next point release: - Upgrade.

Previous Release Notes:

You can view the release notes for previous releases in the release archive:
- docs.wandisco.com/bigdata/wdfusion/archive.html

New Features

WD Fusion 2.8 is a significant new release, and incorporates hundreds of improvements to the Fusion platform. Major feature improvements include:

  • Improved support for IBM Open Platform 4.0 and 4.1 FUS-2352
  • Support for Openstack Swift as a file system target for replication (The Swift Keystone v2 API is supported, and Swift Keystone v3 support is planned for a future release) FUS-976
  • Inclusion of Hive Active/Active replication with the Replicated Hive Metastore Plugin HIVE
  • Replicated directories in Fusion Zones can be marked as read-only FUS-953
  • Usernames applied to metadata can be translated on receipt by a Fusion Zone FUS-2104
  • Update to DConE 1.3.14 FUS-2371
  • Improvements to SSL support FUS-401
  • Improvements to AWS S3 as a file system target for replication FUS-1294
  • Fusion nodes can be configured to operate without needing to accept incoming TCP connections FUI-2564
  • Enhanced filtering, sorting and limiting of file system information FUS-1375
  • Performance improvements to minimize heap usage for consistency checks
  • General improvements to minimize heap usage
  • Performance improvements for increased transaction rates FUS-2421
  • Support added for HDFS setfacl command FUS-1920
  • Improved HTTPS support FUS-1915
  • Improved file checksum support FUS-1888
  • Improved repair task feedback and progress FUS-1857, FUS-1988
  • HCFS support for getAclStatus FUS-1291

Known Issues

  • For installations to IBM Openstack/Swift storage, we currently only support Keystone 2.0. We will be adding support for Keystone 3.0 in a future release. FUS-3025
  • For IBM Big Replicate/IBM Hive deployments, there is currently a limitation that prevents the deployment of the Ambari stack, through WD Fusion UI. The "Deploy Stack" button will not work and you will see a "Failed to deploy Ambari stack: Stack service does not exist..." warning. The work-around for this is to complete the installation of the Stack through Ambari. FUS-3068
  • Currently it's not possible to install WD Fusion with SSL enabled, as the installer is unable to see that the server has started. We'll fix this issue in the next release. The workaround is to enable the SSL after the installation has been completed. FUI-3095
  • A rounding error can, in some specific cases, result in a Consistency Repair reporting either negative time taken or successful completion with 100% remaining. FUS-2492

Hive Metastore Plugin Known Issues

  • Hive transactions not supported.
  • Hive SQL Standard Based Authorization (which provides column-level access control granularity) is not supported, because this mode requires that HiveServer2 runs embedded metastore.
  • Replication between different versions not supported (some combinations might work, but need to be specifically tested).
  • Table directories have to be under the database directory (or at least in the same replicated directory as the database).
  • From CDH version 5.5 onwards, the password to the metastore database is encrypted in the config file. As we are unable to read the password, a workaround is required during the installation. See Steps to fix the Hive Metastore database password file.
  • There is currently a bug where the Consistency Checker tree browser won't display children. FUI-3091
  • [Cloudera-based deployements] When installing the Hive Metastore plugin, you must ensure that the folder /etc/wandisco/hive is created on the server that you are installing the plugin, and that it can be written to by the system account running the Hive Metastore plugin installer. FUI-3121