[Hadoop-RDMA-discuss] RDMA Hadoop hdfs copy issue
Kumar, Ashish
Ashish.A.Kumar at cavium.com
Tue Sep 27 01:39:31 EDT 2016
Hi,
I have setup a two node cluster with "rdma-hadoop-2.x-1.0.0" package.
I am using Mellanox IB adapter.
Data node is setup on slave system.
When I try to copy files in HDFS from slave, it works fine.
But when I try to copy files in HDFS from master, I get an error:
16/09/27 10:30:05 INFO hdfs.DFSClient: Init
16/09/27 10:30:05 INFO hdfs.DFSClient: Creating rdma connection
16/09/27 10:30:05 INFO hdfs.DFSClient: Stream Id = 0
16/09/27 10:30:05 INFO hdfs.DFSClient: Starting responder
16/09/27 10:30:05 INFO hdfs.DFSClient: Responder started
16/09/27 10:30:05 INFO hdfs.DFSClient: waiting on ackArraySize
Name or service not known for hadoop-slave:1234
Connect failed
exchange_ep_info() failed
16/09/27 10:30:05 INFO hdfs.DFSClient: Send header = BP-7238855-127.0.0.1-1474951518749:blk_1073741826_1002
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f552b8f0fbd, pid=51329, tid=0x00007f551fb77700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_101-b13) (build 1.8.0_101-b13)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.101-b13 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C [librdmadfsclient.so.1.0.0+0x6fbd] Java_org_apache_hadoop_hdfs_RdmaDFSClient_ucrSendBlocking+0x62
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /home/bkp_hadoop/dft/hs_err_pid51329.log
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Aborted (core dumped)
Attached the error log file.
Can you please help me out with this issue.
Thanks and Regards,
Ashish Kumar
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/rdma-hadoop-discuss/attachments/20160927/6ceab6c5/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: hs_err_pid51329.log
Type: application/octet-stream
Size: 99118 bytes
Desc: hs_err_pid51329.log
URL: <http://mailman.cse.ohio-state.edu/pipermail/rdma-hadoop-discuss/attachments/20160927/6ceab6c5/attachment-0001.obj>
More information about the RDMA-Hadoop-discuss
mailing list