hive的job运行结束后,数据导入分区报错:Stats aggregator of type counter cannot be connected to
来源:互联网 发布:C语言初始化什么意思 编辑:程序博客网 时间:2024/05/16 07:53
hive的job运行结束后,数据导入分区报错:
[Error 30017]: Skipping stats aggregation by error org.apache.hadoop.hive.ql.metadata.HiveException: [Error 30015]: Stats aggregator of type counter cannot be connected to
2015-05-25 13:19:22,270 Stage-1 map = 100%, reduce = 26%, Cumulative CPU 119.02 sec2015-05-25 13:19:23,302 Stage-1 map = 100%, reduce = 30%, Cumulative CPU 119.99 sec2015-05-25 13:19:24,333 Stage-1 map = 100%, reduce = 36%, Cumulative CPU 122.36 sec2015-05-25 13:19:25,365 Stage-1 map = 100%, reduce = 46%, Cumulative CPU 126.01 sec2015-05-25 13:19:26,393 Stage-1 map = 100%, reduce = 55%, Cumulative CPU 129.21 sec2015-05-25 13:19:27,421 Stage-1 map = 100%, reduce = 65%, Cumulative CPU 133.23 sec2015-05-25 13:19:28,451 Stage-1 map = 100%, reduce = 67%, Cumulative CPU 137.67 sec2015-05-25 13:19:34,681 Stage-1 map = 100%, reduce = 80%, Cumulative CPU 161.0 sec2015-05-25 13:19:36,746 Stage-1 map = 100%, reduce = 81%, Cumulative CPU 167.69 sec2015-05-25 13:19:37,788 Stage-1 map = 100%, reduce = 84%, Cumulative CPU 168.42 sec2015-05-25 13:19:39,858 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 174.31 secMapReduce Total cumulative CPU time: 2 minutes 54 seconds 310 msecEnded Job = job_1427862114883_20334Loading data to table
<pre name="code" class="java">.......
.......
.......省略
.......[Error 30017]: Skipping stats aggregation by error org.apache.hadoop.hive.ql.metadata.HiveException: [Error 30015]: Stats aggregator of type counter cannot be connected to
.......
<pre name="code" class="java">.......
<pre name="code" class="java">.......<span style="font-family: Arial, Helvetica, sans-serif;">省略</span>
.......MapReduce Jobs Launched: Job 0: Map: 2 Reduce: 10 Cumulative CPU: 47.33 sec HDFS Read: 35901149 HDFS Write: 4661055 SUCCESSJob 1: Map: 2 Reduce: 10 Cumulative CPU: 40.75 sec HDFS Read: 4663895 HDFS Write: 2932195 SUCCESSJob 2: Map: 4 Reduce: 10 Cumulative CPU: 174.31 sec HDFS Read: 35089647 HDFS Write: 187955 SUCCESSTotal MapReduce CPU Time Spent: 4 minutes 22 seconds 390 msecOK
解决方法:
hadoop的namenode节点运行:
mr-jobhistory-daemon.sh start historyserver
0 0
- hive的job运行结束后,数据导入分区报错:Stats aggregator of type counter cannot be connected to
- eclipse新导入的项目经常可以看到“XX cannot be resolved to a type”的报错信息
- 导入到eclipse中的项目报错 XXX cannot be resolved to a type
- Button cannot be resolved to a type报错
- 关于WebServlet cannot be resolved to a type报错
- 报错:BASE64Encoder cannot be resolved to a type
- XX cannot be resolved to a type 报错
- hibernate报错:JoinColumn cannot be resolved to a type
- 报错Test cannot be resolved to a type
- 导入Javaweb项目后jsp文件报错:The type java.io.UnsupportedEncodingException cannot be resolved. It is indir
- Class<SpringJUnit4ClassRunner> cannot be resolved to a type spring4.32的junit测试报错解决
- myeclipse2014引用项目内的类 报错 “cannot be resolved to a type”
- java中”XX cannot be resolved to a type”的报错信息
- Eclipse 导入web项目后 报 The type javax.servlet.http.HttpServletRequest cannot be resolved.
- eclipse,myeclipse导入工程报:javax.servlet.jsp.JspException cannot be resolved to a type
- 使用Maven创建Web项目后,jsp引入静态文件提示报错。JSP 报错:javax.servlet.ServletException cannot be resolved to a type
- 使用Maven创建Web项目后,jsp引入静态文件提示报错。JSP 报错:javax.servlet.ServletException cannot be resolved to a type
- java 导入的项目很多都报javax.servlet.jsp cannot be resolved to a type的错误,不是导包问题
- webbrowser学习
- 动态规划——Minimum-sum descent(数塔问题)
- Android大图片裁剪终极解决方案(下:拍照截图)
- Android大图片裁剪终极解决方案(中:从相册截图)
- gdb使用说明
- hive的job运行结束后,数据导入分区报错:Stats aggregator of type counter cannot be connected to
- 【疑难杂症】eclipse每行后边出现奇怪符号
- android获得控件在屏幕中的绝对坐标 getLocationInWindow 和 getLocationOnScreen
- 一步一步跟我学习lucene(14)---lucene搜索之facet查询原理和facet查询实例
- android MotionEvent中getX()和getRawX()的区别
- 设计模式学习笔记--单例模式
- android 判断ListView滚动到底部
- Android Activity四种启动模式
- 搭建nginx反向代理用做内网域名转发