hive的job运行结束后,数据导入分区报错:Stats aggregator of type counter cannot be connected to

来源:互联网 发布:C语言初始化什么意思 编辑:程序博客网 时间:2024/05/16 07:53
hive的job运行结束后,数据导入分区报错:

[Error 30017]: Skipping stats aggregation by error org.apache.hadoop.hive.ql.metadata.HiveException: [Error 30015]: Stats aggregator of type counter cannot be connected to


2015-05-25 13:19:22,270 Stage-1 map = 100%,  reduce = 26%, Cumulative CPU 119.02 sec2015-05-25 13:19:23,302 Stage-1 map = 100%,  reduce = 30%, Cumulative CPU 119.99 sec2015-05-25 13:19:24,333 Stage-1 map = 100%,  reduce = 36%, Cumulative CPU 122.36 sec2015-05-25 13:19:25,365 Stage-1 map = 100%,  reduce = 46%, Cumulative CPU 126.01 sec2015-05-25 13:19:26,393 Stage-1 map = 100%,  reduce = 55%, Cumulative CPU 129.21 sec2015-05-25 13:19:27,421 Stage-1 map = 100%,  reduce = 65%, Cumulative CPU 133.23 sec2015-05-25 13:19:28,451 Stage-1 map = 100%,  reduce = 67%, Cumulative CPU 137.67 sec2015-05-25 13:19:34,681 Stage-1 map = 100%,  reduce = 80%, Cumulative CPU 161.0 sec2015-05-25 13:19:36,746 Stage-1 map = 100%,  reduce = 81%, Cumulative CPU 167.69 sec2015-05-25 13:19:37,788 Stage-1 map = 100%,  reduce = 84%, Cumulative CPU 168.42 sec2015-05-25 13:19:39,858 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 174.31 secMapReduce Total cumulative CPU time: 2 minutes 54 seconds 310 msecEnded Job = job_1427862114883_20334Loading data to table 
<pre name="code" class="java">.......
.......
.......省略
.......
[Error 30017]: Skipping stats aggregation by error org.apache.hadoop.hive.ql.metadata.HiveException: [Error 30015]: Stats aggregator of type counter cannot be connected to
.......
<pre name="code" class="java">.......
<pre name="code" class="java">.......<span style="font-family: Arial, Helvetica, sans-serif;">省略</span>
.......MapReduce Jobs Launched: Job 0: Map: 2  Reduce: 10   Cumulative CPU: 47.33 sec   HDFS Read: 35901149 HDFS Write: 4661055 SUCCESSJob 1: Map: 2  Reduce: 10   Cumulative CPU: 40.75 sec   HDFS Read: 4663895 HDFS Write: 2932195 SUCCESSJob 2: Map: 4  Reduce: 10   Cumulative CPU: 174.31 sec   HDFS Read: 35089647 HDFS Write: 187955 SUCCESSTotal MapReduce CPU Time Spent: 4 minutes 22 seconds 390 msecOK


解决方法:

hadoop的namenode节点运行:

mr-jobhistory-daemon.sh start historyserver





0 0
原创粉丝点击