Hive中常出现的错误(不定时更新)
来源:互联网 发布:淘宝怎么找以前的订单 编辑:程序博客网 时间:2024/06/16 05:22
1.加载数据失败
hive> load data local inpath '/home/user/hive.txt' into table studentl > ;FAILED: SemanticException [Error 10001]: Line 1:56 Table not found 'studentl'hive> load data local inpath '/home/user/hive.txt' into table student;Loading data to table default.studentFailed with exception Unable to move source file:/home/user/hive.txt to destination hdfs://com.qiyu02:8020/user/hive/warehouse/student/hive.txtFAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
在hive日志发现
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/hive/warehouse/student/hive.txt could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and no node(s) are excluded in this operation.at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget(BlockManager.java:1503)at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3124)at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:636)at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.addBlock(AuthorizationProviderProxyClientProtocol.java:188)at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:476)at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:587)at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1026)at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:415)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)at org.apache.hadoop.ipc.Client.call(Client.java:1411)at org.apache.hadoop.ipc.Client.call(Client.java:1364)at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)at com.sun.proxy.$Proxy19.addBlock(Unknown Source)at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:391)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAcces
There are 1 datanode(s) running and no node(s) are excluded in this operation.
大概是datanode(s) 挂掉了 ,敲下jps验证一下,果真如此,不得不重启一下hadoop进程了
2.Hive中运行Mapredurce程序时:
错误:
Ended Job = job_1504575362948_0022 with errors Error during job, obtaining debugging information...
hive (person)> select password from user1;Total jobs = 1Launching Job 1 out of 1Number of reduce tasks is set to 0 since there's no reduce operatorStarting Job = job_1504575362948_0022, Tracking URL = http://com.qiyu02:8088/proxy/application_1504575362948_0022/Kill Command = /opt/modules/hadoop-2.5.0-cdh5.3.6/bin/hadoop job -kill job_1504575362948_0022Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 02017-09-05 11:44:53,804 Stage-1 map = 0%, reduce = 0%Ended Job = job_1504575362948_0022 with errorsError during job, obtaining debugging information...FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTaskMapReduce Jobs Launched: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAILTotal MapReduce CPU Time Spent: 0 msec
网上说法一大堆!说什么内存不够啊、ResourceManger没成功启动啊....等等全试了一遍,还是没解决。。。后来猜测可能是内核的原因,改下内核,重新启动就好了
阅读全文
0 0
- Hive中常出现的错误(不定时更新)
- mysql中常出现的错误
- hadoop中常出现的错误及解决办法
- Android常见的错误整理(不定时更新)
- CUDA内核函数参数不定时出现的错误
- 运行中的错误,不定时更新
- .net中常出现的错误异常的处理
- Eclipse中常出现的错误提示及处理方法
- [Hadoop] Hadoop中常出现的错误以及解决方法
- 一个GCD应用中常出现的几个错误
- iOS 开发过程中常出现的一些错误总结
- Android比较容易忘的错误和bug总结(不定时更新)
- 我的记录(不定时更新)
- Github- iOS备注 (不定时的更新)
- 千奇百怪的博弈论(不定时更新)
- [不定时更新]看到的好文
- carbide编译链接错误汇总,不定时更新
- ios 常见错误及解决办法(不定时更新)
- 关于Socket异步的简单应用
- 关于load和initialize,《深入剖析load和initialize方法》
- easyui-datagrid去除最右空白滚动条边框
- 牛客网日常刷题错题汇总2017-09-05
- Android控件之ProgressBar
- Hive中常出现的错误(不定时更新)
- Androidstudio开发ARcore 步骤
- AndroidUI之控件宝典
- SSh框架 整合Axis2
- bzoj 1650: [Usaco2006 Dec]River Hopscotch 跳石子(二分)
- java基础之IO转换流--OutputStreamWriter(字符流通往字节流,可以指定字符编码的IO流对象)
- Hive日志默认存储在什么位置?
- Unable to read repository at https://dl.bintray.com/jetbrains/kotlin/eclipse-plugin/last/content.xml
- C#--继承的基本使用