[Hadoop-RDMA-discuss] RDMA for Apache Kafka 0.9.1

[Lu, Xiaoyi]

Did you use the  —producer.config flag?

bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test --producer.config config/producer.properties

BTW, you can change the dev.num back to 0.

Xiaoyi

> On Mar 31, 2019, at 10:28 PM, 13813995851 at 139.com wrote:
> 
> hi,
> 
> 13813995851 at 139.com <mailto:13813995851 at 139.com>
>  
> From: Lu, Xiaoyi <mailto:lu.932 at osu.edu>
> Date: 2019-04-01 09:49
> To: 13813995851 at 139.com <mailto:13813995851 at 139.com>
> CC: rdma-hadoop-discuss <mailto:rdma-hadoop-discuss at cse.ohio-state.edu>
> Subject: Re: [Hadoop-RDMA-discuss] RDMA for Apache Kafka 0.9.1
> Are you able to run some basic IB-level tests on your cluster?
> 
> 
>> On Mar 31, 2019, at 9:46 PM, 13813995851 at 139.com <mailto:13813995851 at 139.com> wrote:
>> 
>> I have change the device.num to 1 ,but it  still can't find hca card,
>> [root at test rdma-kafka-0.9.1]# bin/kafka-topics.sh --list --zookeeper localhost:2181 
>> test
>> [root at test rdma-kafka-0.9.1]# bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
>> Cannot find valid HCA
>> at line 319 in file ucr_init.c
>> 
>> 13813995851 at 139.com <mailto:13813995851 at 139.com>
>>  
>> From: Xiaoyi Lu <mailto:lu.932 at osu.edu>
>> Date: 2019-03-29 23:56
>> To: 13813995851 at 139.com <mailto:13813995851 at 139.com>
>> CC: rdma-hadoop-discuss <mailto:rdma-hadoop-discuss at cse.ohio-state.edu>
>> Subject: Re: [Hadoop-RDMA-discuss] RDMA for Apache Kafka 0.9.1
>> Can you change the device.num to 1 and recheck?
>> 
>> Xiaoyi
>> 
>> Sent from my iPhone
>> 
>> On Mar 28, 2019, at 10:21 PM, "13813995851 at 139.com <mailto:13813995851 at 139.com>" <13813995851 at 139.com <mailto:13813995851 at 139.com>> wrote:
>> 
>>> Hi, Xiaoyi,
>>> 
>>> thank you for your reply!
>>> I have set the corresponding config values in the producer.properties, server.properties and consumer.properties files.
>>> but  the HCA card still can't be found?Is there any problem with the attachment log?
>>> 
>>> Best regard!
>>> 13813995851 at 139.com <mailto:13813995851 at 139.com>
>>>  
>>> From: Lu, Xiaoyi <mailto:lu.932 at osu.edu>
>>> Date: 2019-03-29 07:07
>>> To: 13813995851 at 139.com <mailto:13813995851 at 139.com>
>>> CC: rdma-hadoop-discuss <mailto:rdma-hadoop-discuss at cse.ohio-state.edu>
>>> Subject: Re: [Hadoop-RDMA-discuss] RDMA for Apache Kafka 0.9.1
>>> Hi,
>>>  
>>> If you have read our user guide, in Section "4.2 Advanced Configuration”, we have mentioned the following configuration parameters:
>>>  
>>> rdma.dev.name=mlx5_0
>>>  
>>> rdma.dev.num=0
>>>  
>>> You need to set the corresponding config values in the producer.properties, server.properties and consumer.properties files.
>>>  
>>> Xiaoyi
>>>  
>>> > On Mar 28, 2019, at 4:14 AM, 13813995851 at 139.com <mailto:13813995851 at 139.com> wrote:
>>> >
>>> > hello, I encountered a problem when I installed RDMA for Apache Kafka,
>>> > Can you tell me how to solve it?thanks
>>> > [root at test rdma-kafka-0.9.1]# ibstat
>>> > CA 'mlx4_0'
>>> >         CA type: MT4099
>>> >         Number of ports: 1
>>> >         Firmware version: 2.42.5000
>>> >         Hardware version: 1
>>> >         Node GUID: 0xf45214030083ede0
>>> >         System image GUID: 0xf45214030083ede3
>>> >         Port 1:
>>> >                 State: Active
>>> >                 Physical state: LinkUp
>>> >                 Rate: 40 (FDR10)
>>> >                 Base lid: 17
>>> >                 LMC: 0
>>> >                 SM lid: 6
>>> >                 Capability mask: 0x02514868
>>> >                 Port GUID: 0xf45214030083ede1
>>> >                 Link layer: InfiniBand
>>> >
>>> > [root at test rdma-kafka-0.9.1]# bin/kafka-topics.sh --list --zookeeper localhost:2181
>>> > test
>>> > [root at test rdma-kafka-0.9.1]# bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
>>> > Cannot find valid HCA
>>> >  at line 319 in file ucr_init.c
>>> >
>>> > Best regards!
>>> > 13813995851 at 139.com <mailto:13813995851 at 139.com>
>>> > _______________________________________________
>>> > RDMA-Hadoop-discuss mailing list
>>> > RDMA-Hadoop-discuss at cse.ohio-state.edu <mailto:RDMA-Hadoop-discuss at cse.ohio-state.edu>
>>> > http://mailman.cse.ohio-state.edu/mailman/listinfo/rdma-hadoop-discuss <http://mailman.cse.ohio-state.edu/mailman/listinfo/rdma-hadoop-discuss>
>>>  
>>> <kafka.txt>
> 
> <ib_test>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/rdma-hadoop-discuss/attachments/20190401/efa2fd2b/attachment.html>