kafka安装记录

1、准备环境

• 使用VMware安装3台Linux服务器

  • mini版本
  • hostname 依次为 node01、node02、node03
  • 关闭防火墙
    • 每台机器都操作一遍
    • service iptables stop && chkconfig iptables off
  • 配置网卡

  • 配置/etc/hosts文件

    192.168.140.128 node01 zk01 kafka01192.168.140.129 node02 zk02 kafka02192.168.140.130 node03 zk03 kafka03scp /etc/hosts node02:/etc/scp /etc/hosts node03:/etc/

  • 配置Yum

    yum install -y lrzszyum install -y wgetmv /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo.backupcd /etc/yum.repos.dwget http://mirrors.163.com/.help/CentOS6-Base-163.repoyum clean all && yum makecache

  • 配置免密登录

    yum -y install openssh-clientsssh-keygen 四个回车ssh-copy-id node1ssh-copy-id node2ssh-copy-id node3

2、安装JDK&ZK&KAFKA

• 安装JDK

  mkdir -p /export/serversmkdir -p /export/softwaremkdir -p /export/logsmkdir -p /export/datamkdir -p /export/data/zkmkdir -p /export/data/kafkamkdir -p /export/logs/zk-cd /export/software/rz 选择 jdk-8u141-linux-x64.tar.gztar -zxvf jdk-8u141-linux-x64.tar.gz -C ../servers/cd ../servers/mv jdk1.8.0_141 jdksource /etc/profile-export JAVA_HOME=/export/servers/jdkexport JRE_HOME=${JAVA_HOME}/jreexport CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/libexport PATH=${JAVA_HOME}/bin:$PATH-scp -r jdk node02:/export/servers/scp -r jdk node03:/export/servers/scp /etc/profile node02:/etc/scp /etc/profile node03:/etc/-source /etc/profile on node01、node02、node03java -version on node01 on node01、node02、node03

• 安装zookeeper

  cd /export/software/wget http://219.238.7.73/files/703900000A354B91/apache.fayea.com/zookeeper/zookeeper-3.4.9/zookeeper-3.4.9.tar.gztar -zxvf zookeeper-3.4.9.tar.gz -C ../servers/cd ../servers/mv zookeeper-3.4.9/ zk-scp -r zk node02:/export/servers/scp -r zk node03:/export/servers/-touch /export/data/zk/myid on node01、node02、node03echo 1 > /export/data/zk/myid on node01echo 2 > /export/data/zk/myid on node02echo 3 > /export/data/zk/myid on node03-cd /export/servers/zk/conf/touch zoo.cfg vi zoo.cfg-tickTime=2000initLimit=10syncLimit=5dataDir=/export/data/zkdataLogDir=/export/logs/zkclientPort=2181server.1=node01:2887:3887server.2=node02:2887:3887server.3=node03:2887:3887-scp zoo.cfg node02:$PWDscp zoo.cfg node03:$PWD--zkServer.sh start on node01、node02、node03zkServer.sh status on node01、node02、node03

• 安装Kafka

  cd /export/software/wget http://219.238.7.67/files/518200000AE89181/mirror.bit.edu.cn/apache/kafka/1.0.0/kafka_2.11-1.0.0.tgztar -zxvf kafka_2.11-1.0.0.tgz -C ../servers/cd ../servers/mv kafka_2.11-1.0.0 kafka-scp -r kafka node03:/export/servers/scp -r kafka node03:/export/servers/-cd /export/servers/kafka/config/-修改配置文件cd /export/servers/kafka/nohup bin/kafka-server-start.sh config/server.properties & on node01、node02、node03

• 在window使用工具查看kafka集群

  • 首先使用hosts.exe工具配置本地host

    192.168.140.128 node01 zk01 kafka01192.168.140.129 node02 zk02 kafka02192.168.140.130 node03 zk03 kafka03

  • zookeeper_java_client.zip
    • 解压、链接即可。