从头开始学kafka

来源:互联网 发布:appcleaner中文版 mac 编辑:程序博客网 时间:2024/05/29 16:07
###安装部署
1. kafka核心在于集群,所以在此不讲解单节点配置,需先配置好zookeeper环境,详见zookeeper配置文档
2. 以三台虚拟机为例,详细配置过程如下:
a.进入kafka目录下,vim config/server.properties 
 修改brokerid:这个每个server(broker)必须唯一,写数字 
 修改hostname:这个也是唯一的,IP即可
 修改zookeeper.connect = ${ip},${ip},${ip}


###常用命令
3. 启动kafka服务
a.先启动zookeeper再启动kafka
b.启动zookeeper:/usr/local/soft_tool/zookeeper-3.4.5/bin/zkServer.sh start
c.启动kafka:bin/kafka-server-start.sh -daemon ./config/server.properties
4.测试kafka服务
a.创建topic 
bin/kafka-topics.sh --create --zookeeper 10.201.26.205:2181,10.201.26.206:2181,10.201.26.207:2181 --replication-factor 1 --partitions 2 --topic linux_topic

bin/kafka-topics.sh --create --zookeeper 10.201.26.215:2181 --replication-factor 1 --partitions 2 --topic linux_topic

bin/kafka-topics.sh --create --zookeeper 172.16.248.128:2181 --replication-factor 1 --partitions 2 --topic topic1


b.写入数据测试
bin/kafka-console-producer.sh --broker-list 10.201.26.205:9092,10.201.26.206:9092,10.201.26.207:9092 --topic linux_topic

bin/kafka-console-producer.sh --broker-list 192.1.1.213:9092 --topic yuke

bin/kafka-console-producer.sh --broker-list 172.16.248.128:9092 --topic linux_topic


c.接收数据测试
bin/kafka-console-consumer.sh --zookeeper 10.201.26.205:2181,10.201.26.206:2181,10.201.26.207:2181 --topic linux_topic --from-beginning

bin/kafka-console-consumer.sh --zookeeper 192.1.1.205:2181 --topic yuke


bin/kafka-console-consumer.sh --zookeeper 172.16.248.128:2181 --topic linux_topic --from-beginning



d.查看topic
bin/kafka-topics.sh --zookeeper 10.201.26.217:2181 --list

#####删除topic:

bin/kafka-topics.sh --zookeeper localhost:2181 --delete --topic test1
原创粉丝点击