hbase(4):hbase集群安装
来源:互联网 发布:linux shell 编辑:程序博客网 时间:2024/05/22 12:18
1.前提条件hadoop已经安装完成,zookeeper安装完成。
//告诉hbase使用外部的zk
export HBASE_MANAGES_ZK=false
namenode:安装在:hadoop1,hadoop2
zookeeper集群安装在:hadoop4,hadoop5,hadoop6
2.先启动zookeeper
(1)启动第一台zookeeper
登陆到hadoop4,hadoop5,hadoop6
#cd /hadoop/zookeeper-3.4.6/bin
[root@hadoop4 bin]#./zkServer.sh start (2)启动hadoop集群的hdfs,在hadoop1中进行启动。
[root@hadoop1 sbin]# ./start-dfs.sh
Starting namenodes on [hadoop1 hadoop2]
hadoop1: starting namenode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-namenode-hadoop1.out
hadoop2: starting namenode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-namenode-hadoop2.out
hadoop5: starting datanode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-datanode-hadoop5.out
hadoop6: starting datanode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-datanode-hadoop6.out
hadoop4: starting datanode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-datanode-hadoop4.out
Starting journal nodes [hadoop4 hadoop5 hadoop6]
hadoop6: starting journalnode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-journalnode-hadoop6.out
hadoop5: starting journalnode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-journalnode-hadoop5.out
hadoop4: starting journalnode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-journalnode-hadoop4.out
Starting ZK Failover Controllers on NN hosts [hadoop1 hadoop2]
hadoop1: starting zkfc, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-zkfc-hadoop1.out
hadoop2: starting zkfc, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-zkfc-hadoop2.out
[root@hadoop1 sbin]#
Starting namenodes on [hadoop1 hadoop2]
hadoop1: starting namenode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-namenode-hadoop1.out
hadoop2: starting namenode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-namenode-hadoop2.out
hadoop5: starting datanode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-datanode-hadoop5.out
hadoop6: starting datanode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-datanode-hadoop6.out
hadoop4: starting datanode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-datanode-hadoop4.out
Starting journal nodes [hadoop4 hadoop5 hadoop6]
hadoop6: starting journalnode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-journalnode-hadoop6.out
hadoop5: starting journalnode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-journalnode-hadoop5.out
hadoop4: starting journalnode, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-journalnode-hadoop4.out
Starting ZK Failover Controllers on NN hosts [hadoop1 hadoop2]
hadoop1: starting zkfc, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-zkfc-hadoop1.out
hadoop2: starting zkfc, logging to /hadoop/hadoop-2.6.0/logs/hadoop-root-zkfc-hadoop2.out
[root@hadoop1 sbin]#
检查是否启动成功
http://192.168.37.131:50070/
3.进行hbase进行解压缩
将hbase-0.99.2-bin.tar.gz下载文件,上传到/hadoop的目录下面。
解压后
[root@hadoop12 hbase-0.99.2]# pwd
/hadoop/hbase-0.99.2
[root@hadoop12 hbase-0.99.2]# ls
bin CHANGES.txt conf docs hbase-webapps lib LICENSE.txt logs NOTICE.txt README.txt
[root@hadoop12 hbase-0.99.2]#
/hadoop/hbase-0.99.2
[root@hadoop12 hbase-0.99.2]# ls
bin CHANGES.txt conf docs hbase-webapps lib LICENSE.txt logs NOTICE.txt README.txt
[root@hadoop12 hbase-0.99.2]#
4.修改hbase的配置文件
#cd /hadoop/hbase-0.99.2/conf
(1)修改hbase-env.sh
export JAVA_HOME=/usr/java/jdk1.7.0_55//告诉hbase使用外部的zk
export HBASE_MANAGES_ZK=false
(2)修改hbase-site.xml
hbase-site.xml
<configuration>
<!-- 指定hbase在HDFS上存储的路径 -->
<property>
<name>hbase.rootdir</name>
<value>hdfs://ns1/hbase</value>
</property>
<!-- 指定hbase是分布式的 -->
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<!-- 指定zk的地址,多个用“,”分割 -->
<property>
<name>hbase.zookeeper.quorum</name>
<value>hadoop4:2181,hadoop5:2181,hadoop6:2181</value>
<configuration>
<!-- 指定hbase在HDFS上存储的路径 -->
<property>
<name>hbase.rootdir</name>
<value>hdfs://ns1/hbase</value>
</property>
<!-- 指定hbase是分布式的 -->
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<!-- 指定zk的地址,多个用“,”分割 -->
<property>
<name>hbase.zookeeper.quorum</name>
<value>hadoop4:2181,hadoop5:2181,hadoop6:2181</value>
</property>
</configuration>
</configuration>
(3)regionservers修改
hadoop3
hadoop4
hadoop5
hadoop6
hadoop4
hadoop5
hadoop6
(4)拷贝hadoop的core-site.xml与hdfs-site.xml到hbase的conf目录。
scp /hadoop/hadoop-2.6.0/etc/hadoop/core-site.xml /hadoop/hbase-0.99.2/conf/
scp /hadoop/hadoop-2.6.0/etc/hadoop/hdfs-site.xml /hadoop/hbase-0.99.2/conf/
如果不进行拷贝,配置在hbase-site.xml文件中也可以。
(5)拷贝hbase到其他节点
scp -r /hadoop/hbase-0.99.2/ itcast02:/hadoop/ scp -r /hadoop/hbase-0.99.2/ itcast03:/hadoop/
scp -r /hadoop/hbase-0.99.2/ itcast04:/hadoop/
scp -r /hadoop/hbase-0.99.2/ itcast05:/hadoop/
scp -r /hadoop/hbase-0.99.2/ itcast06:/hadoop/
5.将配置好的HBase拷贝到每一个节点并同步时间。
6.启动所有的hbase
(1)分别启动zk
./zkServer.sh start
(2)启动hadoop集群
start-dfs.sh
(3)启动hbase,在主节点上运行:
(1)分别启动zk
./zkServer.sh start
(2)启动hadoop集群
start-dfs.sh
(3)启动hbase,在主节点上运行:
#cd /hadoop/hbase-0.99.2/bin
#./start-hbase.sh
#./start-hbase.sh
7.查看进程hbase
(1)HMaster节点进程
[root@hadoop1 bin]# jps
2703 DFSZKFailoverController
5193 HMaster
5512 Jps
2455 NameNode
You have new mail in /var/spool/mail/root
[root@hadoop1 bin]#
2703 DFSZKFailoverController
5193 HMaster
5512 Jps
2455 NameNode
You have new mail in /var/spool/mail/root
[root@hadoop1 bin]#
(2)子节点进程
[root@hadoop5 bin]# jps
2286 QuorumPeerMain
3389 DataNode
3584 JournalNode
4854 HRegionServer
5061 Jps
You have new mail in /var/spool/mail/root
[root@hadoop5 bin]#
2286 QuorumPeerMain
3389 DataNode
3584 JournalNode
4854 HRegionServer
5061 Jps
You have new mail in /var/spool/mail/root
[root@hadoop5 bin]#
(3)页面显示
http://192.168.37.131:16030
8.添加一个Hmaster服务,使得集群更加可靠。
在hadoop2机器上启动
#cd /hadoop/hbase-0.99.2/bin
[root@hadoop2 bin]# ./hbase-daemon.sh start master
starting master, logging to /hadoop/hbase-0.99.2/logs/hbase-root-master-hadoop2.out
[root@hadoop2 bin]# jps
5349 HMaster
2381 NameNode
2438 DFSZKFailoverController
5412 Jps
starting master, logging to /hadoop/hbase-0.99.2/logs/hbase-root-master-hadoop2.out
[root@hadoop2 bin]# jps
5349 HMaster
2381 NameNode
2438 DFSZKFailoverController
5412 Jps
0 0
- hbase(4):hbase集群安装
- hbase集群安装
- Hbase集群安装配置
- HBase集群安装
- hbase集群安装
- hadoop集群安装hbase
- hbase集群安装
- HBASE集群安装
- 安装hbase集群
- Hbase 集群环境安装
- HBase集群安装配置
- HBase-0.98集群安装
- HBase集群安装
- Hbase集群安装步骤
- <Hadoop>HBase 集群安装
- Hbase集群安装
- HBase集群安装
- hbase集群安装
- 每日一得--RSA加密算法原理
- Service(1)
- Mark下看到的东西
- 6.4.8 缓存实例的不可变类
- @EProvider加强contentprovider
- hbase(4):hbase集群安装
- 消息队列与 ActiveMQ, RabbitMQ,ZeroMQ 等
- 32. PHP 比较运算符
- iOS利用Runtime自定义控制器POP手势动画
- ORACLE_基础十五--Loading Data into a Database
- emacs
- GOF23设计模式之装饰模式之理解
- stm32f103学习笔记——关键字extern、static、const
- 大小端