Hbase集群安装配置-四节点-Centos6.9

来源:互联网 发布:淘宝网官网下载最新版 编辑:程序博客网 时间:2024/05/16 04:21

最近在研究Hadoop相关组件的安装,本篇主要研究Hbase的安装。Hbase作为Hadoop家族中重要的数据库解决方案,对以后的Hive等数据库都有非常大的帮助。

准备工作

本节主要阐述Hbase集群的环境。

  1. 系统环境:Linux6.9;
  2. JAVA:JDK1.8.0_111;
  3. Hadoop:2.6.0;
  4. Zookeeper:3.4.9(3节点:slave1/slave2/slave3)。

下载文件

一般Apache的项目,可以从官网上选择相应的镜像作为下载站点,版主以清华大学的镜像作为下载站点,速度比较快。下载完成以后,直接解压即可:

tar -xf hbase-1.2.4-bin.tar.gz

直接解压到当前路径下。

配置启动

Hbase的配置,主要是对于Hbase-env.sh/Hbase-site.sh的配置。
Hbase环境配置Hbase-env.sh:

# 配置主要HOMEexport JAVA_HOME=/home/appuser/jdkexport HADOOP_HOME=/home/appuser/hadoopexport HBASE_HOME=/home/appuser/hbase# 配置RegionServerexport HBASE_REGIONSERVERS=/home/appuser/hbase/conf/regionservers# true:Hbase自己管理Zookeeper# flase:通过独立Zookeeper管理export HBASE_MANAGES_ZK=false 

Hbase主要参数配置Hbase-site.sh:

<property>    <name>hbase.rootdir</name>    <value>hdfs://master:9000/user/hbase</value></property><property>    <name>hbase.cluster.distributed</name>    <value>true</value></property><property>    <name>hbase.replication</name>    <value>true</value></property><property>    <name>hbase.master</name>    <value>maste:60000</value></property><property>    <name>hbase.zookeeper.quorum</name>    <value>slave1,slave2,slave3</value></property><property>    <name>hbase.zookeeper.property.clientport</name>    <value>2181</value></property>

Hbase的regionservers配置:

slave1slave2slave3

基于以上配置之后,可以在Master节点启动Hbase :

~/hbase/bin/start-hbase.sh start

如果出现以下类似信息,说明只在Master节点启动,RegionServer没有启动:

starting regionserver, logging to /home/appuser/hbase/logs/hbase-appuser-regionserver-hs-slave1.outJava HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

如果启动成功,会出现下面的类似信息:

starting master, logging to /home/appuser/hbase/logs/hbase-appuser-master-master.outJava HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0slave3: starting regionserver, logging to /home/appuser/hbase/logs/hbase-appuser-regionserver-slave3.outslave2: starting regionserver, logging to /home/appuser/hbase/logs/hbase-appuser-regionserver-hs-slave2.outslave1: starting regionserver, logging to /home/appuser/hbase/logs/hbase-appuser-regionserver-hs-slave1.outslave3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0slave3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0slave2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0slave2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0slave1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0slave1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

测试Hbase

首先可以启动Hbase测试是否正确安装Hbase,如果启动过程没有报错信息,那么安装成功:
1
其次可以创建表,写入内容,查看是否正常,如果正常说明安装成功:
2

通过以上操作以后,可以查看Hadoop相应路径上是否存在数据:
3

另外,可以通过WebUI确定RegionServer是否启动,端口是否正常,地址:[You URL:16010/]:
4

通过页面可以看出确实存在3个RegionServer,且每个Server只有一个Region 。

  1. Hbase-site中配置的NAME中的值,最好选择小写。版主第一次使用大写,结果配置没有生效;
  2. 每台机器上都配置JAVA_HOME变量,安装JDK。如果没有,会报错Java Not Found;
  3. Zookeeper选择奇数(1,3,5,7…)台机器安装,本例3个节点安装。
0 0
原创粉丝点击