云计算（二十七）- 安装Zookeeper和hbase

安装zookeeper

vi /etc/security/limits.conf

hadoop - nofile  32768

hadoop soft/hard nproc 32000

 

vi /etc/pam.d/login

session required  pam_limits.so

 

上传文件

 

tar xfz zookeeper-3.4.5.tar.gz

vi /etc/profile.d/java.sh

export JAVA_HOME=/home/software/jdk1.7.0_45

export HADOOP_HOME=/home/software/hadoop-2.2.0

export ZOOLEEPER_HOME=/home/software/zookeeper-3.4.5

export PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$ZOOLEEPER_HOME:$PATH:

 

source /etc/profile

 

 

新建文件夹：

/home/software/zookeeperData

/home/software/zookeeperData/data

/home/software/zookeeperData/logs

/home/software/zookeeperData/tmp

 

修改配置文件：单机

伪分布式：http://blog.csdn.net/poechant/article/details/6633923

集群：http://www.blogjava.net/hello-yun/archive/2012/05/03/377250.html

cd /home/software/zookeeper-3.4.5/conf

vi zoo.cfg

tickTime=2000

dataDir=/home/software/zookeeperData/data

dataLogDir=/home/software/zookeeperData/logs

clientPort=2181

cd /home/software/zookeeper-3.4.5/bin

./zkServer.sh start

执行./zkServer.sh status ，

echo stat | nc –q 1 localhost，

echo stat | nc localhost 2181 查看状态

执行echo ruok | nc localhost 2181

执行结果为 imok  是I am ok的意思表示安装并启动成功

关闭zookeeper

./zkServer.sh stop

 安装Hbase

解压hbase

tar zxf hbase-0.96.0-hadoop2-bin.tar.gz

替换文件：将下面的文件替换成2.2版

hadoop-annotations-2.1.0-beta.jar

hadoop-auth-2.1.0-beta.jar

hadoop-client-2.1.0-beta.jar

hadoop-common-2.1.0-beta.jar

hadoop-hdfs-2.1.0-beta.jar

hadoop-hdfs-2.1.0-beta-tests.jar

hadoop-mapreduce-client-app-2.1.0-beta.jar

hadoop-mapreduce-client-common-2.1.0-beta.jar

hadoop-mapreduce-client-core-2.1.0-beta.jar

hadoop-mapreduce-client-jobclient-2.1.0-beta.jar

hadoop-mapreduce-client-jobclient-2.1.0-beta-tests.jar

hadoop-mapreduce-client-shuffle-2.1.0-beta.jar

hadoop-yarn-api-2.1.0-beta.jar

hadoop-yarn-client-2.1.0-beta.jar

hadoop-yarn-common-2.1.0-beta.jar

hadoop-yarn-server-common-2.1.0-beta.jar

hadoop-yarn-server-nodemanager-2.1.0-beta.jar

配置环境变量：

vi /etc/profile.d/java.sh

export JAVA_HOME=/home/software/jdk1.7.0_45

exportHADOOP_HOME=/home/software/hadoop-2.2.0

exportZOOLEEPER_HOME=/home/software/zookeeper-3.4.5

export HBASE_HOME=/home/software/hbase-0.96.0-hadoop2

exportPATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$ZOOLEEPER_HOME/bin:$HBASE_HOME/bin:$PATH:

 

source /etc/profile

配置：

vi hbase-env.sh

export JAVA_HOME=/home/software/jdk1.7.0_45

cd /home/software/hadoop-2.2.0/etc/hadoop

vi hdfs-site.xml

 

<property>
  <name>dfs.support.append</name>
  <value>true</value>
</property>
<property>
  <name>dfs.datanode.max.xcievers</name>
  <value>4096</value>
</property>

cd /home/software/hbase-0.96.0-hadoop2/conf

vi hbase-site.xml

<configuration>

<property>

 <name>hbase.rootdir</name>

 <value>hdfs://master:9000/hbase</value>

</property>

<property>

 <name>hbase.cluster.distributed</name>

 <value>true</value>

</property>

<property>

 <name>hbase.master</name>

 <value>hdfs://master:60000</value>

</property>

<property>

 <name>hbase.tmp.dir</name>

 <value>/home/software/temple</value>

</property>

<property>

 <name>hbase.zookeeper.quorum</name>

 <value>master</value>

</property>

<property>

 <name>hbase.zookeeper.property.clientPort</name>

 <value>2181</value>

</property>

<property>

 <name>hbase.zookeeper.property.dataDir</name>

 <value>/home/software/zookeeperData/data</value>

</property>

</configuration>

 

hbase.rootdir设置hbase在hdfs上的目录，主机名为hdfs的namenode节点所在的主机
hbase.cluster.distributed设置为true，表明是完全分布式的hbase集群
hbase.master设置hbase的master主机名和端口
hbase.tmp.dir设置hbase的临时文件目录
hbase.zookeeper.quorum设置zookeeper的主机，建议hi使用单数
hbase.zookeeper.property.clientPort设置zookeeper的端口
hbase.zookeeper.property.dataDir设置zookeeper的存储目录

 

配置 conf/regionservers

master

 

启动Hadoop

cd /home/software/hadoop-2.2.0/sbin

./start-dfs.sh

./start-yarn.sh

启动zookeeper

cd /home/software/zookeeper-3.4.5/bin

./zkServer.sh start

启动hbase

cd /home/software/hbase-0.96.0-hadoop2/bin

./start-hbase.sh

测试：

进入shell模式

hbase shell

create 'member','m_id','address','info'

hbase(main):002:0> list

TABLE                                                                                              

member