[HiBD] Announcing the release of RDMA for Apache Hadoop-3.x 0.9.1

[Panda, Dhabaleswar]

The High-Performance Big Data (HiBD) team is pleased to announce the
release of Hadoop-3.x 0.9.1 package (for Hadoop 3.x series) with the
following features.

The complete set of features for RDMA Apache Hadoop-3.x 0.9.1:
    - Based on Apache Hadoop 3.0.0
    - Compliant with Apache Hadoop 3.0.0 APIs and applications
    - Support for RDMA Device Selection
    - High-performance design with native InfiniBand and RoCE support
      at the verbs level for HDFS components
    - Supports deploying Hadoop with Slurm and PBS
    - Easily configurable for different running modes (HHH and HHH-M)
    and different protocols (native InfiniBand, RoCE, and IPoIB)
    - On-demand connection setup
    - Support for RDMA Device Selection
    - HDFS over native InfiniBand and RoCE
        - RDMA-based write
        - RDMA-based replication
        - Overlapping in different stages of write and replication
        - Enhanced hybrid HDFS design with in-memory and heterogeneous
          storage (HHH)
            - Supports two modes of operations
                - HHH (default) with I/O operations over RAM disk, SSD, and HDD
                - HHH-M (in-memory) with I/O operations in-memory
            - Policies to efficiently utilize heterogeneous storage
              devices (RAM Disk, SSD, and HDD)
                - Greedy and Balanced policies support
                - Automatic policy selection based on available storage types
            - Hybrid replication (in-memory and persistent storage) for
              HHH default mode
            - Memory replication (in-memory only with lazy persistence) for
              HHH-M mode
    - Tested with
        - Mellanox InfiniBand adapters (QDR, FDR, and EDR)
        - RoCE support with Mellanox adapters
        - RAM Disks, SSDs, and HDDs
        - OpenJDK and IBM JDK

For downloading RDMA for Apache Hadoop-3.x 0.9.1 package and the
associated user guide, please visit the following URL:

http://hibd.cse.ohio-state.edu

Sample performance numbers for benchmarks using RDMA for Apache
Hadoop-3.x 0.9.1 version can be viewed by visiting the `Performance'
tab of the above website.

All questions, feedback and bug reports are welcome. Please post it to
the rdma-hadoop-discuss mailing list (rdma-hadoop-discuss at
cse.ohio-state.edu).

Thanks,

The High-Performance Big Data (HiBD) Team

PS: The number of organizations using the HiBD stacks has crossed 295
(from 34 countries). Similarly, the number of downloads from the HiBD
site has crossed 28,300.  The HiBD team would like to thank all its
users and organizations!!