Linux_Kafka 集群安装笔记

来源:互联网 发布:nginx squid 缓存 编辑:程序博客网 时间:2024/06/14 15:46

环境:Vmware Workstation 10,CentOS-7-x86_64-DVD-1511.iso,Xshell 4.0,ip1:192.168.216.138,ip2:192.168.216.139,ip3:192.168.216.140.

参照Linux_Zookeeper 安装笔记准备一组zookeeper集群。

参照Linux_Kafka 安装笔记在ip1,ip2和ip3上各安装一台kafka,到下面这一步:

[root@localhost ~]# mv /usr/local/kafka_2.12-0.10.2.1/ /usr/local/kafka

ip1

[root@localhost ~]# vim /usr/local/kafka/config/server.properties

broker.id=1
listeners=PLAINTEXT://192.168.216.138:9092
advertised.listeners=PLAINTEXT://192.168.216.138:9092
log.retention.hours=168
message.max.byte=5242880
default.replication.factor=2
replica.fetch.max.bytes=5242880
zookeeper.connect=192.168.216.138:2181,192.168.216.139:2181,192.168.216.140:2181

ip2

[root@localhost ~]# vim /usr/local/kafka/config/server.properties

broker.id=2
listeners=PLAINTEXT://192.168.216.139:9092
advertised.listeners=PLAINTEXT://192.168.216.139:9092
log.retention.hours=168
message.max.byte=5242880
default.replication.factor=2
replica.fetch.max.bytes=5242880
zookeeper.connect=192.168.216.138:2181,192.168.216.139:2181,192.168.216.140:2181

ip3

[root@localhost ~]# vim /usr/local/kafka/config/server.properties

broker.id=3
listeners=PLAINTEXT://192.168.216.140:9092
advertised.listeners=PLAINTEXT://192.168.216.140:9092
log.retention.hours=168
message.max.byte=5242880
default.replication.factor=2
replica.fetch.max.bytes=5242880
zookeeper.connect=192.168.216.138:2181,192.168.216.139:2181,192.168.216.140:2181

ip1, ip2和ip3
注意:下面命令中“–”是两个“-”,csdn显示有误。

[root@localhost ~]# firewall-cmd –zone=public –add-port=9092/tcp –permanent

success

[root@localhost ~]# firewall-cmd –reload

success

[root@localhost ~]# /usr/local/kafka/bin/kafka-server-start.sh -daemon /usr/local/kafka/config/server.properties

ip1

[root@localhost ~]# /usr/local/kafka/bin/kafka-topics.sh –create –zookeeper localhost:2181 –replication-factor 2 –partitions 1 –topic test

[root@localhost ~]# /usr/local/kafka/bin/kafka-console-producer.sh –broker-list 192.168.216.138:9092 –topic test

ip2

[root@localhost ~]# /usr/local/kafka/bin/kafka-console-consumer.sh –bootstrap-server 192.168.216.139:9092 –topic test –from-beginning

ip3

[root@localhost ~]# /usr/local/kafka/bin/kafka-console-consumer.sh –bootstrap-server 192.168.216.140:9092 –topic test –from-beginning

然后在ip1上生产消息,ip2和ip3消费消息。

原创粉丝点击