MapReduce安装配置

来源：互联网发布：淘宝商品图片拍摄技巧编辑：程序博客网时间：2024/05/18 02:00

1、mapred-site.xml配置

<configuration>  <property>     <name>mapreduce.framework.name</name>     <value>yarn</value>  </property></configuration>

2、 yarn-site.xml

<configuration>    <property>        <name>yarn.nodemanager.aux-services</name>        <value>mapreduce_shuffle</value>    </property>    <property>        <name>yarn.resourcemanager.ha.enabled</name>        <value>true</value>    </property>    <property>        <name>yarn.resourcemanager.cluster-id</name>        <value>cluster1</value>    </property>    <property>        <name>yarn.resourcemanager.ha.rm-ids</name>        <value>rm1,rm2</value>    </property>    <property>        <name>yarn.resourcemanager.hostname.rm1</name>        <value>node03</value>    </property>    <property>        <name>yarn.resourcemanager.hostname.rm2</name>        <value>node04</value>    </property>    <property>        <name>yarn.resourcemanager.zk-address</name>        <value>node02:2181,node03:2181,node04:2181</value>    </property></configuration>

3、需要手动启动RecourceManager（node03/node04）

yarn-daemon.sh start resourcemanager

阅读全文

0 0