Hadoop JobHistory异常

来源：互联网发布：炉石传说数据查询编辑：程序博客网时间：2024/04/28 12:50

hadoop jobhistory记录下已运行完的MapReduce作业信息并存放在指定的HDFS目录下，默认情况下是没有启动的，需要配置完后手工启动服务。

mapred-site.xml添加如下配置

<property>  <span style="white-space:pre"></span><name>mapreduce.jobhistory.address</name>  <span style="white-space:pre"></span><value>hadoop000:10020</value>  <span style="white-space:pre"></span><description>MapReduce JobHistory Server IPC host:port</description>  </property>  <property>  <span style="white-space:pre"></span><name>mapreduce.jobhistory.webapp.address</name>  <span style="white-space:pre"></span><value>hadoop000:19888</value>  <span style="white-space:pre"></span><description>MapReduce JobHistory Server Web UI host:port</description>  </property>  <property>    <span style="white-space:pre"></span><name>mapreduce.jobhistory.done-dir</name>    <span style="white-space:pre"></span><value>/history/done</value>  </property>  <property>    <span style="white-space:pre"></span><name>mapreduce.jobhistory.intermediate-done-dir</name>    <span style="white-space:pre"></span><value>/history/done_intermediate</value>

 </property>

启动history-server：

$HADOOP_HOME/sbin/mr-jobhistory-daemon.sh start historyserver

停止history-server：

$HADOOP_HOME/sbin/mr-jobhistory-daemon.sh stop historyserver

0 0