kafka+zookeeper环境配置(Mac 或者 linux环境)
来源:互联网 发布:知可之伯母邪恶漫画 编辑:程序博客网 时间:2024/05/18 02:15
一.zookeeper下载与安装
1)下载
adeMacBook-Pro:zookeeper_soft apple$ wget http://mirrors.cnnic.cn/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
2)解压
tar zxvf zookeeper-3.4.6.tar.gz
3)配置
cd zookeeper-3.4.6
cp -rf conf/zoo_sample.cfg conf/zoo.cfg
vim zoo.cfg
zoo.cfg:
# The number of milliseconds of each ticktickTime=2000# The number of ticks that the initial # synchronization phase can takeinitLimit=10# The number of ticks that can pass between # sending a request and getting an acknowledgementsyncLimit=5# the directory where the snapshot is stored.# do not use /tmp for storage, /tmp here is just # example sakes.dataDir=/Users/apple/Documents/soft/zookeeper_soft/zkdata #这个目录是预先创建的# the port at which the clients will connectclientPort=2181# the maximum number of client connections.# increase this if you need to handle more clients#maxClientCnxns=60## Be sure to read the maintenance section of the # administrator guide before turning on autopurge.## http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance## The number of snapshots to retain in dataDir#autopurge.snapRetainCount=3# Purge task interval in hours# Set to "0" to disable auto purge feature#autopurge.purgeInterval=1
4)启动zookeeper
adeMacBook-Pro:bin apple$ sh zkServer.sh startJMX enabled by defaultUsing config: /Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../conf/zoo.cfg-n Starting zookeeper ... STARTEDadeMacBook-Pro:bin apple$ ps ax| grep zookeeper.out 10311 s003 S+ 0:00.01 grep zookeeper.outadeMacBook-Pro:bin apple$ ps ax| grep zookeeper10307 s003 S 0:00.63 /usr/bin/java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../build/classes:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../build/lib/*.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../lib/slf4j-log4j12-1.6.1.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../lib/slf4j-api-1.6.1.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../lib/netty-3.7.0.Final.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../lib/log4j-1.2.16.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../lib/jline-0.9.94.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../zookeeper-3.4.6.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../src/java/lib/*.jar:/Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /Users/apple/Documents/soft/zookeeper_soft/zookeeper-3.4.6/bin/../conf/zoo.cfg
二 下载并且安装kafka(预先得安装配置好scala的环境,Mac环境参照:http://www.cnblogs.com/super-d2/p/4534208.html)
1).下载kafka:
wget http://apache.fayea.com/kafka/0.8.2.1/kafka_2.10-0.8.2.1.tgz
http://apache.dataguru.cn/kafka/0.9.0.0/kafka_2.10-0.9.0.0.tgz
http://apache.fayea.com/kafka/0.9.0.0/kafka_2.10-0.9.0.0.tgz
http://mirror.bit.edu.cn/apache/kafka/0.9.0.0/kafka_2.10-0.9.0.0.tgz
http://mirrors.cnnic.cn/apache/kafka/0.9.0.0/kafka_2.10-0.9.0.0.tgz
http://mirrors.hust.edu.cn/apache/kafka/0.9.0.0/kafka_2.10-0.9.0.0.tgz
2) 解压:
tar -zxf kafka_2.10-0.8.2.1.tgz
3)启动kafka
adeMacBook-Pro:kafka_2.10-0.8.2.1 apple$ sh bin/kafka-server-start.sh config/server.properties
备注:要挂到后台使用:
sh bin/kafka-server-start.sh config/server.properties &
4)新建一个TOPIC
adeMacBook-Pro:bin apple$ sh kafka-topics.sh --create --topic kafkatopic --replication-factor 1 --partitions 1 --zookeeper localhost:2181
备注:要挂到后台使用:
sh kafka-topics.sh --create --topic kafkatopic --replication-factor 1 --partitions 1 --zookeeper localhost:2181 &
5) 把KAFKA的生产者启动起来:
adeMacBook-Pro:bin apple$ sh kafka-console-producer.sh --broker-list localhost:9092 --sync --topic kafkatopic
备注:要挂到后台使用:
sh kafka-console-producer.sh --broker-list localhost:9092 --sync --topic kafkatopic &
6)另开一个终端,把消费者启动起来:
adeMacBook-Pro:bin apple$ sh kafka-console-consumer.sh --zookeeper localhost:2181 --topic kafkatopic --from-beginning
备注:要挂到后台使用:
sh kafka-console-consumer.sh --zookeeper localhost:2181 --topic kafkatopic --from-beginning &
7)使用
- 在发送消息的终端输入aaa,则可以在消费消息的终端显示,如下图所示:
kafka+zookeeper环境配置(Mac 或者 linux环境)
0 0
- kafka+zookeeper环境配置(Mac 或者 linux环境)
- kafka+zookeeper环境配置(Mac 或者 linux环境)
- kafka+zookeeper环境配置(Mac 或者 linux环境)
- kafka+zookeeper环境配置(Mac 或者 linux环境)
- kafka+zookeeper环境配置(Mac 或者 linux环境)
- kafka+zookeeper环境配置(linux环境单机版)
- kafka+zookeeper环境配置(linux环境单机版)
- kafka+zookeeper环境配置
- Linux下kafka和zookeeper环境搭配
- zookeeper+kafka环境搭建
- zookeeper+kafka环境搭建
- mac kafka 环境搭建
- 搭mongodb+zookeeper+kafka环境
- Zookeeper+kafka集群环境搭建
- Linux 环境zookeeper HA配置注意事项
- Linux 环境zookeeper HA配置注意事项
- 5.配置kafka环境
- Mac os 或者linux下sublime text 3配置c++编译环境
- 对【委托的执行方法】的测试与理解
- CodeForces - 27E Number With The Given Amount Of Divisors (反素数入门)
- ubuntu下Qt cannot find -lGL错误的解决方法
- java中的格式输出
- ScheduledExecutorService定时周期执行指定的任务
- kafka+zookeeper环境配置(Mac 或者 linux环境)
- 【算法训练】八皇后问题回溯算法求解
- sql 根据经纬度求距离
- Android startActivityForResult(intent, requestCode)的用法。
- C、c++ .h 头文件的作用
- 01背包 的简述
- The C++ Standard Library: shared_ptr and unique_ptr
- Linux学习笔记(四、目录处理命令)
- 【Codeforces Round 330 (Div 2)A】【水题】Vitaly and Night 多少间房间有人