Hadoop2.5.1 ResourceManager HA
来源:互联网 发布:迅雷 for mac 老版本 编辑:程序博客网 时间:2024/05/18 14:28
Hadoop在2.4以后引入了ResourceManager HA,避免了单点失败。
官方文档:ResourceManager High Availability
按照之前的安装配置,使用master和master2两台主机作ResourceManager的HA。
按照文档说明,我们对yarn-site.xml进行配置:
<configuration><!-- Site specific YARN configuration properties --><property><name>yarn.nodemanager.aux-services</name><value>mapreduce_shuffle</value></property><property><name>yarn.nodemanager.pmem-check-enabled</name><value>false</value></property><property><name>yarn.nodemanager.vmem-check-enabled</name><value>false</value></property><property><name>yarn.resourcemanager.ha.enabled</name><value>true</value></property><property><name>yarn.resourcemanager.recovery.enabled</name><value>true</value></property><property><name>yarn.resourcemanager.cluster-id</name><value>cluster1</value></property><property><name>yarn.resourcemanager.ha.rm-ids</name><value>rm1,rm2</value></property><property><name>yarn.resourcemanager.hostname.rm1</name><value>master</value></property><property><name>yarn.resourcemanager.hostname.rm2</name><value>master2</value></property><property><name>yarn.resourcemanager.zk-address</name><value>zookeeper1:2181,zookeeper2:2181,zookeeper3:2181</value></property><property><name>yarn.resourcemanager.store.class</name><value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore</value></property></span></configuration>
分别执行命令,启动ResourceManager,可以看到两台机器都有了ResourceManager进程。
yarn-daemon.sh start resourcemanager
登录http://master:8088/和http://master2:8088/能看到主备情况,可以kill ResourceManager进程进行切换测试。
附一些切换命令:
hdfs haadmin -transitionToActive/transitionToStandbyyarn rmadmin -transitionToActive/transitionToStandbyhdfs haadmin -transitionToActive --forcemanual nn1
0 0
- Hadoop2.5.1 ResourceManager HA
- hadoop2中ResourceManager的HA
- ZooKeeper+Hadoop2.6.0的ResourceManager HA搭建
- ZooKeeper+Hadoop2.6.0的ResourceManager HA搭建
- Hadoop2.4的ResourceManager HA高可用配置
- ResourceManager HA
- ResourceManager HA
- Resourcemanager HA
- hadoop2.x通过Zookeeper来实现namenode的HA方案以及ResourceManager单点故障的解决方案
- HBase+ZooKeeper+Hadoop2.6.0的ResourceManager HA集群高可用配置
- HBase+ZooKeeper+Hadoop2.6.0的ResourceManager HA集群高可用配置
- hadoop2.x通过Zookeeper来实现namenode的HA方案以及ResourceManager单点故障的解决方案
- HBase+ZooKeeper+Hadoop2.6.0的ResourceManager HA集群高可用配置
- HBase+ZooKeeper+Hadoop2.6.0的ResourceManager HA集群高可用配置
- resourcemanager ha 配置
- ResourceManager HA 配置
- Hadoop2.5.1 HDFS HA(QJM)
- Hadoop 2.0 ResourceManager HA原理
- Access中SQL语句与其他数据库的区别
- android学习----overridePendingTransition
- Duilib学习笔记《07》— 资源加载
- C++中的static关键字的总结(1)
- ceph存储 ceph集群journal设置
- Hadoop2.5.1 ResourceManager HA
- Oracle_ERP系統借贷关系表
- 一道动态规划的题目
- bsearch函数
- android 多线程
- C++中的static关键字的总结(2)
- storm 简介及单机版安装指南
- Duilib扩展《01》— 双击、右键消息扩展
- 数据库使用