hbase0.98分布式部署
来源:互联网 发布:阿里云邮箱注销 编辑:程序博客网 时间:2024/06/01 09:31
两个master,两个regionserver
hbaes-env.sh:
# The directory where pid files are stored. /tmp by default.export HBASE_PID_DIR=/home/master/platform/hbase-0.98.1-cdh5.1.0/pids# Seconds to sleep between slave commands. Unset by default. This# can be useful in large clusters, where, e.g., slave rsyncs can# otherwise arrive faster than the master can service them.# export HBASE_SLAVE_SLEEP=0.1# Tell HBase whether it should manage it's own instance of Zookeeper or not.#export HBASE_MANAGES_ZK=true# The default log rolling policy is RFA, where the log file is rolled as per the size defined for the # RFA appender. Please refer to the log4j.properties file to see more details on this appender.# In case one needs to do log rolling on a date change, one should set the environment property# HBASE_ROOT_LOGGER to "<DESIRED_LOG LEVEL>,DRFA".# For example:# HBASE_ROOT_LOGGER=INFO,DRFA# The reason for changing default to RFA is to avoid the boundary case of filling out disk space as # DRFA doesn't put any cap on the log size. Please refer to HBase-5655 for more context.export JAVA_HOME=/home/master/program/jdk1.7.0_55-clouderaexport HBASE_HOME=/home/master/platform/hbase-0.98.1-cdh5.1.0#export HBASE_OPTS="$HBASE_OPTS -XX:+HeapDumpOnOutOfMemoryError -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode"export HBASE_OPTS="$HBASE_OPTS -ea -XX:+HeapDumpOnOutOfMemoryError -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80"export HBASE_OPTS="$HBASE_OPTS -XX:+UseParNewGC -XX:NewRatio=3 -XX:NewSize=512m"export HBASE_SSH_OPTS="-p 2208"#HBASE_JMX_OPTS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false"#HBASE_JMX_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.password.file=$HBASE_HOME/conf/jmxremote.passwd"#HBASE_JMX_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.access.file=$HBASE_HOME/conf/jmxremote.access"#export HBASE_MASTER_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.port=10101"#export HBASE_REGIONSERVER_OPTS="$HBASE_JMX_OPTS -Dcom.sun.management.jmxremote.port=10102"export HBASE_MASTER_OPTS="$HBASE_MASTER_OPTS -Xmx4096m"export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS -Xmx4096m -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC -XX:+PrintGCDateStamps -Xloggc:/home/master/platform/hbase-0.98.1-cdh5.1.0/gc//hbasegc.vgc"export HBASE_THRIFT_OPTS="$HBASE_THRIFT_OPTS -Xmx0m"export HBASE_CLASSPATH=/home/master/platform/hadoop-2.3.0-cdh5.1.0/etc/hadoopexport HBASE_MANAGES_ZK=true
hbase-site.xml:
<configuration> <property> <name>hbase.rootdir</name> <value>hdfs://hadoop3:8020/data/hbase</value> </property> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property> <property> <name>hbase.master</name> <value>hadoop1:60000,hadoop2:60000</value> </property> <property> <name>hbase.client.write.buffer</name> <value>2097152</value> </property> <property> <name>hbase.client.pause</name> <value>100</value> </property> <property> <name>hbase.client.retries.number</name> <value>35</value> </property> <property> <name>hbase.client.scanner.caching</name> <value>100</value> </property> <property> <name>hbase.client.keyvalue.maxsize</name> <value>10485760</value> </property> <property> <name>hbase.rpc.timeout</name> <value>60000</value> </property> <property> <name>hbase.snapshot.enabled</name> <value>true</value> </property> <property> <name>hbase.security.authentication</name> <value>simple</value> </property> <property> <name>zookeeper.session.timeout</name> <value>60000</value> </property> <!-- <property> <name>zookeeper.znode.parent</name> <value>/hbase</value> </property> --> <property> <name>zookeeper.znode.rootserver</name> <value>root-region-server</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>hadoop1,hadoop2,hadoop3</value> </property> <property> <name>hbase.zookeeper.property.clientPort</name> <value>2181</value> </property>
3,然后copy到另一台机器:
在start-hbase.sh
如果备用的 master没有启动:在该节点上执行 bin/hbase-daemon.sh start master
0 0
- hbase0.98分布式部署
- 分布式hbase0.90.5搭建
- Hbase0.23分布式安装
- Hbase0.98版本的安装部署配置管理(Hadoop2.3、Hbase0.98、Hive0.13整合)
- Hbase0.98版本的安装部署配置管理(Hadoop2.3、Hbase0.98、Hive0.13整合)
- Hbase0.98版本的安装部署配置管理(Hadoop2.3、Hbase0.98、Hive0.13整合)
- hadoop2.5.0和hbase0.98完全分布式安装
- 【Apache Hadoop系列】Hadoop1.0.4+zookeeper3.5.4+hbase0.94.5分布式部署
- Flume1.5.0的安装、部署、简单应用(含分布式、与hadoop2.2.0、hbase0.96的案例)
- hadoop2.2.0+zookeeper3.4.5+hbase0.96.2+hive0.13.1分布式环境部署
- ubuntu12.04+hadoop2.2.0+zookeeper3.4.5+hbase0.96.2+hive0.13.1伪分布式环境部署
- ubuntu12.04+hadoop2.2.0+zookeeper3.4.5+hbase0.96.2+hive0.13.1伪分布式环境部署
- Flume1.5.0的安装、部署、简单应用(含伪分布式、与hadoop2.2.0、hbase0.96的案例
- (4) Flume1.5.0的安装、部署、简单应用(含伪分布式、与hadoop2.2.0、hbase0.96的案例) (1-8)
- Flume1.5.0的安装、部署、简单应用(含伪分布式、与hadoop2.2.0、hbase0.96的案例)
- Flume1.5.0的安装、部署、简单应用(含伪分布式、与hadoop2.2.0、hbase0.96的案例)
- Flume1.5.0的安装、部署、简单应用(含伪分布式、与hadoop2.2.0、hbase0.96的案例)
- Hadoop1.2.1+Hbase0.94.14完全分布式安装
- 深入理解HTTP协议
- dom4j解析xml文档
- COM组件开发(三)——类厂对象
- Linux查看系统信息大全[备忘]
- 回形取数
- hbase0.98分布式部署
- 11g 搜集直方图导致不走索引
- 事务的隔离级别
- iOS开发-Protocol协议及委托代理(Delegate)传值
- 算法
- [POJ2826] An Easy Problem?! && 计算几何
- HTML5 canvas 做画板画图 可以做电子白板
- REST架构
- MVC开发模型浅谈