Storm搭建、安装、以及环境配置

来源:互联网 发布:手机号码绑定的软件 编辑:程序博客网 时间:2024/06/06 09:20

准备工作:

 

1. 首先安装zookeeper,然后验证zookeeper正确性:

 

 

bin/zkCli.sh -server 127.0.0.1:2181

 

2.安装kafka

Download a recent stable release.

> tar xzf kafka-<VERSION>.tgz> cd kafka-<VERSION>> ./sbt update> ./sbt package

 

安装Storm

 

1)安装ZeroMQ:

wget http://download.zeromq.org/historic/zeromq-2.1.7.tar.gz

tar -xzf zeromq-2.1.7.tar.gz

cd zeromq-2.1.7

./configure

make

sudo make install

 

2)jzmq dependencies 依赖包

sudo yum install uuid*

sudo yum install libtool

sudo yum install libuuid

sudo yum install libuuid-devel

 

3)安装 jzmq

git clone https://github.com/nathanmarz/jzmq.git

cd jzmq

./autogen.sh

./configure

make

sudo make install

 

4)装python 2.6.6

wget http://www.python.org/ftp/python/2.6.6/Python-2.6.6.tgz

tar -xvzf Python-2.6.6.tgz

cd Python-2.6.6

./configure --prefix=/usr/local/python

make

sudo make install

创建一个python2.6的链接

sudo ln -sf /usr/local/python/bin/python2.6 /usr/bin/python

 

5)配置storm.yaml

storm.zookeeper.servers:

  - "10.131.18.5"

  - "10.131.18.6"

  - "10.131.18.7"

nimbus.host: "10.131.18.7"

storm.local.dir: "/home/dcplatform/storm-0.7.0/data" 

ui.port: 18080

更多Storm的参数:

https://raw.github.com/nathanmarz/storm/master/conf/defaults.yaml

 

5)启动storm

启动nimbus: nohup bin/storm nimbus &

启动UI:一般在nimbus上。nohup bin/storm ui &

查看UI:http://10.131.18.7:18080/

启动supervisor :在不同的机器。nohup bin/storm supervisor &

 

6)查看进程

ps aux | grep storm.ui 

ps aux | grep nimbus

ps aux | grep supervisor

 

 

 

另:发现另外一篇安装:

http://blog.sina.com.cn/s/blog_8ae7b3fe010124mr.html

 

Mac安装Storm

http://blog.sina.com.cn/s/blog_8ae7b3fe01013yrv.html

原创粉丝点击