[HiBD] Announcing the release of RDMA-Memcached 0.9.6 and OSU HiBD-Benchmarks (OHB) 0.9.3
Panda, Dhabaleswar
panda at cse.ohio-state.edu
Sat Dec 23 11:29:18 EST 2017
The High-Performance Big Data (HiBD) team is pleased to announce the
release of RDMA-Memcached 0.9.6 and OSU HiBD-Benchmarks (OHB) 0.9.3
with the following features.
* RDMA-Memcached 0.9.6 Features
- Memcached server designs based on Memcached 1.5.3
- Compliant with the Memcached’s new item chaining feature in
In-Memory mode
- Compliant with the latest Memcached’s LRU maintainer and
slab balancer enhancements
- Memcached client designs based on libMemcached 1.0.18
- High-performance design with native InfiniBand and RoCE support at
the verbs-level for Memcached Server and Client
- High-performance design of SSD-assisted hybrid memory
- Support for enabling and disabling direct I/O for SSD read/write
- Runtime selection of HCA device for nodes equipped with multiple
InfiniBand/RoCE HCAs
- Enable and disable item chaining through extended server options
- Compliant with libMemcached APIs and applications
- Non-Blocking Libmemcached Set/Get API extensions
- APIs to issue non-blocking set/get requests to the RDMA-based Memcached
servers
- APIs to support monitoring the progress of non-blocking requests issued
in an asynchronous fashion
- Facilitating overlap of concurrent set/get requests
- Support for burst-buffer mode in Lustre-integrated design of HDFS in RDMA
for Apache Hadoop-2.x
- Support for both RDMA-enhanced and socket-based Memcached clients
- Easily configurable for native InfiniBand, RoCE, and the traditional
sockets-based support (Ethernet and InfiniBand with IPoIB)
- On-demand connection setup
- Tested with
- Native Verbs-level support with Mellanox InfiniBand adapters (DDR, QDR,
FDR, and EDR)
- RoCE support with Mellanox adapters
- Various multi-core platforms
- SATA-SSD, PCIe-SSD, and NVMe-SSD
* OSU HiBD-Benchmarks 0.9.3 Feature
- Micro-benchmarks for Hadoop Distributed File System (HDFS)
- Sequential Write Latency (SWL) Benchmark
- Sequential Read Latency (SRL) Benchmark
- Random Read Latency (RRL) Benchmark
- Sequential Write Throughput (SWT) Benchmark
- Sequential Read Throughput (SRT) Benchmark
- Support benchmarking
- Apache Hadoop 1.x and 2.x HDFS
- Hortonworks Data Platform (HDP) HDFS
- Cloudera Distribution of Hadoop (CDH) HDFS
- Micro-benchmarks for Memcached
- Get Latency Benchmark
- Set Latency Benchmark
- Mixed Get/Set Latency Benchmark
- Non-Blocking API Latency Benchmark
- Hybrid Memory Latency Benchmark
- Yahoo! Cloud Serving Benchmark (YCSB) Extension for RDMA-Memcached
- Micro-benchmarks for HBase
- Get Latency Benchmark
- Put Latency Benchmark
- Micro-benchmarks for Spark
- GroupBy
- SortBy
For downloading RDMA-Memcached 0.9.6 and OSU HiBD-Benchmarks 0.9.3
packages, the associated user guides, please visit the following URL:
http://hibd.cse.ohio-state.edu
Sample performance numbers for RDMA-Memcached using OHB benchmarks can
be viewed by visiting the `Performance' tab of the above website.
All questions, feedback and bug reports are welcome. Please post to
the rdma-memcached-discuss mailing list (rdma-memcached-discuss at
cse.ohio-state.edu).
Thanks,
The High-Performance Big Data (HiBD) Team
http://hibd.cse.ohio-state.edu
PS: We are also happy to inform that the number of organizations using
HiBD libraries (and registered at the HiBD site) has crossed 275
worldwide (in 34 countries). The number of downloads from the HiBD
site has crossed 24,000. The HiBD team would like to thank all its
users and organizations!!
More information about the hibd-announce
mailing list