hadoop2.6完全分布式环境搭建(下-->配置文件)

来源：互联网发布：卡通设计软件编辑：程序博客网时间：2024/05/18 03:42

hadoop2.6完全分布式环境搭建(下–>配置文件)

1.在/usr/hadoop目录下新建如下目录(可省略该步骤）

mkdir /dfs

mkdir /dfs/name

mkdir /dfs/data

mkdir /tmp

2.配置文件：hadoop-env.sh

修改JAVA_HOME值

3.配置文件：mapred-env.sh

修改JAVA_HOME值

4.配置文件：yarn-env.sh

修改JAVA_HOME值

5.配置文件：core-site.xml

<configuration>       <property>                <name>fs.defaultFS</name>                <value>hdfs://master:8020</value>       </property>       <property>                <name>io.file.buffer.size</name>                <value>131072</value>        </property>       <property>               <name>hadoop.tmp.dir</name>               <value>file:/usr/hadoop/tmp</value>               <description>Abase for other temporary   directories.</description>       </property>        <property>               <name>hadoop.proxyuser.u0.hosts</name>               <value>*</value>       </property>       <property>               <name>hadoop.proxyuser.u0.groups</name>               <value>*</value>       </property></configuration>

6.配置文件：hdfs-site.xml

<configuration>       <property>                <name>dfs.namenode.secondary.http-address</name>               <value>master:9001</value>       </property>     <property>             <name>dfs.namenode.name.dir</name>             <value>file:/usr/hadoop/dfs/name</value>       </property>      <property>              <name>dfs.datanode.data.dir</name>              <value>file:/usr/hadoop/dfs/data</value>       </property>       <property>               <name>dfs.replication</name>               <value>3</value>        </property>        <property>                 <name>dfs.webhdfs.enabled</name>                  <value>true</value>         </property></configuration>

7.配置文件：mapred-site.xml

<configuration>          <property>                                                                  <name>mapreduce.framework.name</name>                <value>yarn</value>           </property>          <property>                  <name>mapreduce.jobhistory.address</name>                  <value>master:10020</value>          </property>          <property>                <name>mapreduce.jobhistory.webapp.address</name>                <value>master:19888</value>       </property></configuration>

8.配置文件：yarn-site.xml

<configuration>        <property>               <name>yarn.nodemanager.aux-services</name>               <value>mapreduce_shuffle</value>        </property>        <property>                                                                <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>               <value>org.apache.hadoop.mapred.ShuffleHandler</value>        </property>        <property>               <name>yarn.resourcemanager.address</name>               <value>master:8032</value>       </property>       <property>               <name>yarn.resourcemanager.scheduler.address</name>               <value>master:8030</value>       </property>       <property>            <name>yarn.resourcemanager.resource-tracker.address</name>             <value>master:8031</value>      </property>      <property>              <name>yarn.resourcemanager.admin.address</name>               <value>master:8033</value>       </property>       <property>               <name>yarn.resourcemanager.webapp.address</name>               <value>master:8088</value>       </property></configuration>

hadoop namenode -format
start-all.sh

0 0