hbase0.98分布式部署

来源:互联网 发布:阿里云邮箱注销 编辑:程序博客网 时间:2024/06/01 09:31

两个master,两个regionserver


hbaes-env.sh:


# The directory where pid files are stored. /tmp by default.export HBASE_PID_DIR=/home/master/platform/hbase-0.98.1-cdh5.1.0/pids# Seconds to sleep between slave commands.  Unset by default.  This# can be useful in large clusters, where, e.g., slave rsyncs can# otherwise arrive faster than the master can service them.# export HBASE_SLAVE_SLEEP=0.1# Tell HBase whether it should manage it's own instance of Zookeeper or not.#export HBASE_MANAGES_ZK=true# The default log rolling policy is RFA, where the log file is rolled as per the size defined for the # RFA appender. Please refer to the log4j.properties file to see more details on this appender.# In case one needs to do log rolling on a date change, one should set the environment property# HBASE_ROOT_LOGGER to "<DESIRED_LOG LEVEL>,DRFA".# For example:# HBASE_ROOT_LOGGER=INFO,DRFA# The reason for changing default to RFA is to avoid the boundary case of filling out disk space as # DRFA doesn't put any cap on the log size. Please refer to HBase-5655 for more context.export JAVA_HOME=/home/master/program/jdk1.7.0_55-clouderaexport HBASE_HOME=/home/master/platform/hbase-0.98.1-cdh5.1.0#export HBASE_OPTS="$HBASE_OPTS -XX:+HeapDumpOnOutOfMemoryError -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode"export HBASE_OPTS="$HBASE_OPTS -ea -XX:+HeapDumpOnOutOfMemoryError -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80"export HBASE_OPTS="$HBASE_OPTS -XX:+UseParNewGC -XX:NewRatio=3 -XX:NewSize=512m"export HBASE_SSH_OPTS="-p 2208"#HBASE_JMX_OPTS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false"#HBASE_JMX_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.password.file=$HBASE_HOME/conf/jmxremote.passwd"#HBASE_JMX_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.access.file=$HBASE_HOME/conf/jmxremote.access"#export HBASE_MASTER_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.port=10101"#export HBASE_REGIONSERVER_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.port=10102"export HBASE_MASTER_OPTS="$HBASE_MASTER_OPTS -Xmx4096m"export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS -Xmx4096m -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC -XX:+PrintGCDateStamps -Xloggc:/home/master/platform/hbase-0.98.1-cdh5.1.0/gc//hbasegc.vgc"export HBASE_THRIFT_OPTS="$HBASE_THRIFT_OPTS -Xmx0m"export HBASE_CLASSPATH=/home/master/platform/hadoop-2.3.0-cdh5.1.0/etc/hadoopexport HBASE_MANAGES_ZK=true

hbase-site.xml:

<configuration>   <property>           <name>hbase.rootdir</name>           <value>hdfs://hadoop3:8020/data/hbase</value>     </property>     <property>               <name>hbase.cluster.distributed</name>               <value>true</value>     </property>          <property>        <name>hbase.master</name>        <value>hadoop1:60000,hadoop2:60000</value>    </property>     <property>    <name>hbase.client.write.buffer</name>    <value>2097152</value>  </property>  <property>    <name>hbase.client.pause</name>    <value>100</value>  </property>  <property>    <name>hbase.client.retries.number</name>    <value>35</value>  </property>  <property>    <name>hbase.client.scanner.caching</name>    <value>100</value>  </property>  <property>    <name>hbase.client.keyvalue.maxsize</name>    <value>10485760</value>  </property>  <property>    <name>hbase.rpc.timeout</name>    <value>60000</value>  </property>  <property>    <name>hbase.snapshot.enabled</name>    <value>true</value>  </property>  <property>    <name>hbase.security.authentication</name>    <value>simple</value>  </property>  <property>    <name>zookeeper.session.timeout</name>    <value>60000</value>  </property>  <!--  <property>    <name>zookeeper.znode.parent</name>    <value>/hbase</value>  </property>  -->  <property>    <name>zookeeper.znode.rootserver</name>    <value>root-region-server</value>  </property>     <property>     <name>hbase.zookeeper.quorum</name>      <value>hadoop1,hadoop2,hadoop3</value>   </property>   <property>        <name>hbase.zookeeper.property.clientPort</name>        <value>2181</value>  </property>

3,然后copy到另一台机器:

在start-hbase.sh

如果备用的 master没有启动:在该节点上执行    bin/hbase-daemon.sh start master

0 0