ResourceManager HA

来源：互联网发布：注册岩土工程师知乎编辑：程序博客网时间：2024/05/19 03:23

#一、介绍
Hadoop 2.2没怎么关注过，太新，bug太多。2.4的更新直接自己带了，Namenode有HA和Federation，RM也有了HA，而且也可以通过ZKFC自动做故障切换。大概从2.4开始，Hadoop就可以往生产环境逐渐切换了。
#二、配置
<property>
<name>yarn.resourcemanager.ha.enabled</name>
<value>true</value>
</property>

<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>

<property>
<name>yarn.resourcemanager.hostname.rm1</name>
<value>192.168.1.2</value>
</property>

<property>
<name>yarn.resourcemanager.hostname.rm2</name>
<value>192.168.1.3</value>
</property>

<property>
<name>yarn.resourcemanager.recovery.enabled</name>
<value>true</value>
</property>

<property>
<name>yarn.resourcemanager.store.class</name>
<value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore</value>
</property>

<property>
<name>yarn.resourcemanager.zk-address</name>
<value>192.168.1.2:2181,192.168.1.3:2181</value>
<description>For multiple zk services, separate them with comma</description>
</property>

<property>
<name>yarn.resourcemanager.cluster-id</name>
<value>yarn-ha</value>
</property>
#三、参考paper
http://slaytanic.blog.51cto.com/2057708/1423227

0 0