Release Notes

WD Fusion 2.1.3

May 8, 2015

This release adds support in our orchestration script for installing to any number of data centers.

New functionality

• Performance improvements
• Orchestration script support for more than 2 data centers
• File Pull (Beta release)

Known Issues

• The orchestrate-fusion.sh currently does not support CDH RPMs.


• Hive from CDH 5.3 does not work with WD Fusion, as a result of HIVE-9991. The issue will be addressed once this fix for Hive is released.


• Hive from CDH 5.4 will also fail with WD Fusion, resulting in the following message:

  FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.wandisco.fs.client.FusionFs not found)
  



• Do not locate WD Fusion on the same node as HDFS processors, especially DataNodes
  HDFS's default block placement policy dictates that if a client is co-located on a DataNode, then that co-located DataNode will receive 1 block of whatever file is being put into HDFS from that client. This means that if the WD Fusion Server (where all transfers go through) is co-located on a DataNode, then all incoming transfers will place 1 block onto that DataNode. In which case the DataNode is likely to consumes lots of disk space in a transfer-heavy cluster, potentially forcing the WD Fusion Server to shut down in order to keep the Prevaylers from getting corrupted.

Certified Platforms / DMBS and DConE Support

• HDP 2.1.2 - 2.2.X
• PHD 3.0, IBM BI 3.0
• CDH 5.1 - 5.4
• EMC Isilon 7.2
• MapR M5,7
• DConE 1.3
• MySQL (Hive MetaStore)

Client Apps Supported

• Hive
• Spark
• SQL
• Impala*
• HBase
• SQOOP
• Flume
• Kafka
• Storm

WD Fusion 2.1.2

May 1, 2015

This release supports multiple IHC servers for load balancing and failover. Also includes first file pull, WD Fusion no longer waits for a file to be completely written and closed on the data center of origin before data is transmitted to the other nodes. Users can configure increments for data transfer (e.g. 16MB,32MB,63MB etc).

New functionality

• Inter-Hadop Connect Server HA
• Kerberos Support
• File Pull (initial release)

Certified Platforms / DMBS and DConE Support

• HDP 2.1.2 - 2.2.X
• PHD 3.0, IBM BI 3.0
• CDH 5.1 - 5.4
• EMC Isilon 7.2
• MapR M5,7
• DConE 1.3
• MySQL (Hive MetaStore)

Client Apps Supported

• Hive
• Spark
• SQL
• Impala*
• HBase
• SQOOP
• Flume
• Kafka
• Storm

WD Fusion 2.1.1

April 24, 2015

Added support for SSL encryption.

New functionality

• Support for SSL encryption
• Updates to the Admin UI

Certified Platforms / DMBS and DConE Support

• HDP 2.1.2 - 2.2.X
• PHD 3.0, IBM BI 3.0
• CDH 5.1 - 5.4
• EMC Isilon 7.2
• MapR M5,7
• DConE 1.3
• MySQL (Hive MetaStore)

Client Apps Supported

• Hive
• Spark
• SQL
• Impala*
• HBase
• SQOOP
• Flume
• Kafka
• Storm

WD Fusion 2.1

April 15, 2015

WD Fusion enters "General Availability". This release includes integration for MapR in addition to EMC Islion, CHD, HDP, MapR and PHD 3.0.

New functionality

• Added support for MapR.

Certified Platforms / DMBS and DConE Support

• HDP 2.1.2 - 2.2.X
• PHD 3.0, IBM BI 3.0
• CDH 5.1 - 5.4
• EMC Isilon 7.2
• MapR M5,7
• DConE 1.3
• MySQL (Hive MetaStore)

Client Apps Supported

• Hive
• Spark
• SQL
• Impala*
• HBase
• SQOOP
• Flume
• Kafka
• Storm