[HiBD] Announcing the release of RDMA for Apache Hadoop-2.x 0.9.1
Panda, Dhabaleswar
panda at cse.ohio-state.edu
Tue Aug 19 15:30:51 EDT 2014
The RDMA for Apache Hadoop team is pleased to announce the release of
Hadoop-2.x 0.9.1 package (for Hadoop 2.x series) with the following
features.
* RDMA for Apache Hadoop-2.x 0.9.1 Features
- Based on Apache Hadoop 2.4.1
- High performance design with native InfiniBand and RoCE
support at the verbs level for the HDFS component
- Compliant with Apache Hadoop 2.4.1 APIs and applications
- Easily configurable for native InfiniBand, RoCE, and the
traditional sockets based support (Ethernet and InfiniBand
with IPoIB)
- On-demand connection setup
- HDFS over native InfiniBand and RoCE
- RDMA-based write
- RDMA-based replication
- Parallel replication support
- Optimizations for SSD
- Tested with
- Mellanox InfiniBand adapters (DDR, QDR and FDR)
- RoCE support with Mellanox adapters
- Various multi-core platforms
- Different file systems with disks and SSDs
For downloading RDMA for Apache Hadoop-2.x 0.9.1 package and the
associated user guide, please visit the following URL:
http://hibd.cse.ohio-state.edu
Sample performance numbers for benchmarks using RDMA for Apache
Hadoop-2.x 0.9.1 version can be viewed by visiting the `Performance'
tab of the above website.
All questions, feedbacks and bug reports are welcome. Please post it
to the rdma-hadoop-discuss mailing list (rdma-hadoop-discuss at
cse.ohio-state.edu).
Thanks,
The High-Performance Big Data (HiBD) Team
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/hibd-announce/attachments/20140819/602d0083/attachment.html>
More information about the hibd-announce
mailing list