[Hadoop-RDMA-discuss] RDMA for Apache Kafka 0.9.1

[Lu, Xiaoyi]

Are you able to run some basic IB-level tests on your cluster?


> On Mar 31, 2019, at 9:46 PM, 13813995851 at 139.com wrote:
> 
> I have change the device.num to 1 ,but it  still can't find hca card,
> [root at test rdma-kafka-0.9.1]# bin/kafka-topics.sh --list --zookeeper localhost:2181 
> test
> [root at test rdma-kafka-0.9.1]# bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
> Cannot find valid HCA
> at line 319 in file ucr_init.c
> 
> 13813995851 at 139.com <mailto:13813995851 at 139.com>
>  
> From: Xiaoyi Lu <mailto:lu.932 at osu.edu>
> Date: 2019-03-29 23:56
> To: 13813995851 at 139.com <mailto:13813995851 at 139.com>
> CC: rdma-hadoop-discuss <mailto:rdma-hadoop-discuss at cse.ohio-state.edu>
> Subject: Re: [Hadoop-RDMA-discuss] RDMA for Apache Kafka 0.9.1
> Can you change the device.num to 1 and recheck?
> 
> Xiaoyi
> 
> Sent from my iPhone
> 
> On Mar 28, 2019, at 10:21 PM, "13813995851 at 139.com <mailto:13813995851 at 139.com>" <13813995851 at 139.com <mailto:13813995851 at 139.com>> wrote:
> 
>> Hi, Xiaoyi,
>> 
>> thank you for your reply!
>> I have set the corresponding config values in the producer.properties, server.properties and consumer.properties files.
>> but  the HCA card still can't be found?Is there any problem with the attachment log?
>> 
>> Best regard!
>> 13813995851 at 139.com <mailto:13813995851 at 139.com>
>>  
>> From: Lu, Xiaoyi <mailto:lu.932 at osu.edu>
>> Date: 2019-03-29 07:07
>> To: 13813995851 at 139.com <mailto:13813995851 at 139.com>
>> CC: rdma-hadoop-discuss <mailto:rdma-hadoop-discuss at cse.ohio-state.edu>
>> Subject: Re: [Hadoop-RDMA-discuss] RDMA for Apache Kafka 0.9.1
>> Hi,
>>  
>> If you have read our user guide, in Section "4.2 Advanced Configuration”, we have mentioned the following configuration parameters:
>>  
>> rdma.dev.name=mlx5_0
>>  
>> rdma.dev.num=0
>>  
>> You need to set the corresponding config values in the producer.properties, server.properties and consumer.properties files.
>>  
>> Xiaoyi
>>  
>> > On Mar 28, 2019, at 4:14 AM, 13813995851 at 139.com <mailto:13813995851 at 139.com> wrote:
>> >
>> > hello, I encountered a problem when I installed RDMA for Apache Kafka,
>> > Can you tell me how to solve it?thanks
>> > [root at test rdma-kafka-0.9.1]# ibstat
>> > CA 'mlx4_0'
>> >         CA type: MT4099
>> >         Number of ports: 1
>> >         Firmware version: 2.42.5000
>> >         Hardware version: 1
>> >         Node GUID: 0xf45214030083ede0
>> >         System image GUID: 0xf45214030083ede3
>> >         Port 1:
>> >                 State: Active
>> >                 Physical state: LinkUp
>> >                 Rate: 40 (FDR10)
>> >                 Base lid: 17
>> >                 LMC: 0
>> >                 SM lid: 6
>> >                 Capability mask: 0x02514868
>> >                 Port GUID: 0xf45214030083ede1
>> >                 Link layer: InfiniBand
>> >
>> > [root at test rdma-kafka-0.9.1]# bin/kafka-topics.sh --list --zookeeper localhost:2181
>> > test
>> > [root at test rdma-kafka-0.9.1]# bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
>> > Cannot find valid HCA
>> >  at line 319 in file ucr_init.c
>> >
>> > Best regards!
>> > 13813995851 at 139.com <mailto:13813995851 at 139.com>
>> > _______________________________________________
>> > RDMA-Hadoop-discuss mailing list
>> > RDMA-Hadoop-discuss at cse.ohio-state.edu <mailto:RDMA-Hadoop-discuss at cse.ohio-state.edu>
>> > http://mailman.cse.ohio-state.edu/mailman/listinfo/rdma-hadoop-discuss <http://mailman.cse.ohio-state.edu/mailman/listinfo/rdma-hadoop-discuss>
>>  
>> <kafka.txt>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/rdma-hadoop-discuss/attachments/20190331/434ec877/attachment.html>