Release Notes

WD Fusion 2.3 Build 172 - June 5 2015

Work continues on refining the consistency checking tool. In a future release we look to add inconsistency handling features, currently resynchronization is handled through those system tools that correspond with the underlying Hadoop application.

The 2.3 release is the first step towards making WD Fusion available to download freely for evaluation. As part of this work additional development has been completed on license handling and validation.

Available Packages

TBA. The engineering team are looking at providing an up-to-date list of the available packages.

System Requirements

Before you install this software you must ensure that you meet the necessary system, software and hardware requirements for running WD Fusion. See a full checklist in our online user guide: docs.wandisco.com/bigdata/wdfusion/

Supported Hadoop Packages:

View our list of supported versions of Hadoop: - docs.wandisco.com/bigdata/wdfusion/install.html#supported

Certified Platforms / DBMS & DConE Support:

• HDP2.1.2 - 2.2.X
• PHD3.0
• CDH5.15 5.4
• EMC Isilon 7.2
• MapR M5,7
• DConE 1.3
• MySQL (Hive MetaStore)

Client Applications Supported:

• Hive
• SparkSQL
• Impala* Some current limitations - contact WANdisco's solutions team
• HBase SQOOP
• Flume
• Kafka
• Storm

Installation

You can find detailed instructions on how to get up and running in our online user guide:
- docs.wandisco.com/bigdata/wdfusion/install.html#procedure

Upgrades from an earlier version:

It's essential that you remove previously installed versions of WD Fusion before you complete a new installation:
- docs.wandisco.com/bigdata/wdfusion/install.html#cleanup

Previous Release Notes:

You can view the release notes for previous releases in the release archive:
- docs.wandisco.com/bigdata/wdfusion/archive.html

Known issues

• Spark files input can't be used for streaming from replicated folders directly and checkpointing could work incorrectly. (FUS-611)


• Hive from CDH 5.3 does not work with WD Fusion, as a result of HIVE-9991. The issue will be addressed once this fix for Hive is released.


• Hive from CDH 5.4 will also fail with WD Fusion, resulting in the following message:

  
  FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.wandisco.fs.client.FusionFs not found) 
  

  (FUS-455)


• Do not locate WD Fusion on the same server as other HDFS processors, especially DataNodes. HDFS's default block placement policy dictates that if a client is co-located on a DataNode, then that co-located DataNode will receive 1 block of whatever file is being put into HDFS from that client. This means that if the WD Fusion Server (where all transfers go through) is co-located on a DataNode, then all incoming transfers will place 1 block onto that DataNode. In which case the DataNode is likely to consumes lots of disk space in a transfer-heavy cluster, potentially forcing the WD Fusion Server to shut down in order to keep the Prevaylers from getting corrupted. (FUS-453)


• Impala does not work with WD Fusion. Impala is not able to read data from non-HDFS file systems, which is how Impala sees Fusion. With Fusion 2.3 a Fusion Impala client will be available that will enable Fusion to support Impala reads without modifications to CDH, the Hive Metastore, or the customer's Impala applications. This should satisfy the vast majority of customer use cases, since Impala is typically used for fast read performance. Most customers use Hive to write data to HDFS and modify the Hive metastore, which Impala also uses.
  If the customer is using Impala for both reads and writes a workaround is available to the field upon request. (FUS-476)

New Features

• Talkback script is now bundled with the installation. Should you need to contact WANdisco support, the Talkback script automates the gathering of logs and system files that may be required to diagnose problems. See more about Talkback


• Changes have been made to the product licensing engine to support the coming release of a free-to-download evaluation. (FUS-505)

Fixed Issues

• Various improvements and refinements to the installer.


• Talkback script now correctly verifies if security is enabled. (FUS-310)


• Improvements made to the password encurpter module. (FUS-560)


• Updated fusion_env.sh script with FUSION_SERVER_USER and FUSION_IHC_SERVER_USER (FUS-620)


• /opt/fusion/ihc-server directory now properly cleaned when the IHC RPM is removed. (FUS-532)