HIVE1.1.0报错记录
来源:互联网 发布:云控软件 编辑:程序博客网 时间:2024/05/16 18:36
运行环境:
HADOOP 2.2.0
ZOOKEEPER 3.4.6
HIVE 1.1.0
现象:
配置好hive-site.xml后执行Create Table正常,执行insert报错,日志如下:
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hdfs.DFSClient.getKeyProvider()Lorg/apache/hadoop/crypto/key/KeyProvider;
at org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.<init>(Hadoop23Shims.java:1152)
at org.apache.hadoop.hive.shims.Hadoop23Shims.createHdfsEncryptionShim(Hadoop23Shims.java:1279)
at org.apache.hadoop.hive.ql.session.SessionState.getHdfsEncryptionShim(SessionState.java:392)
at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.isPathEncrypted(SemanticAnalyzer.java:1756)
at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getStagingDirectoryPathname(SemanticAnalyzer.java:1875)
at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1689)
at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1427)
at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genResolvedParseTree(SemanticAnalyzer.java:10132)
at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10147)
at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:192)
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:222)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:421)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:307)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1112)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1160)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1039)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:207)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:159)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:370)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:754)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
diff --git a/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java b/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.javaindex 7c1887a20d53abd92bca8cb5f9b78030a38f9657..82833a33876e25bf75ae5dad0533c4c4a4ab6cbc 100644--- a/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java+++ b/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java@@ -1281,7 +1281,12 @@ private int compareKeyStrength(String keyname1, String keyname2) throws IOExcept public HadoopShims.HdfsEncryptionShim createHdfsEncryptionShim(FileSystem fs, Configuration conf) throws IOException { URI uri = fs.getUri(); if ("hdfs".equals(uri.getScheme())) {- return new HdfsEncryptionShim(uri, conf);+ try {+ return new HdfsEncryptionShim(uri, conf);+ } catch (NoSuchMethodError e) {+ // ignore error as encryption is not supported.+ // let this method return the unsupported encryption shim instead+ } } return new HadoopShims.NoopHdfsEncryptionShim(); }删除 "-" 后面的内容
1.svn co http://svn.apache.org/repos/asf/hive/trunk hive //下载源码
2.根据上述修改源码详情内容修改 hive/shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
3.CD hive
mvn clean install -Phadoop-2,dist4.cd packaging/target/apache-hive-{version}-SNAPSHOT-bin/apache-hive-{version}-SNAPSHOT-bin//编译好后存放目录
- HIVE1.1.0报错记录
- hive1.2.1 MoveTask报错
- hive1.2启动报错jline
- hadoop2.6.0+hive1.2启动报错java.lang.IncompatibleClassChangeError
- Hive1.1.0 安装
- Hive1.2.1 启动报错 ClassNotFoundException: org.apache.hadoop.hive.service.HiveServer
- hive启动报错:hive1.1.1和0.13的jline的差别
- hue3.9 集成 hive1.1.0
- 报错记录
- 编译器报错记录
- Android 报错记录
- 报错记录
- Sqoop报错记录
- Android报错记录
- 报错记录
- 报错记录
- 报错记录
- selenium报错记录
- atoi 的 C 语言实现
- jquery图表工具
- 7-1通信系统中为什么要进行编码和解码?常见的编码方法有哪些?
- python模块:xlsxwriter和xlrd相结合读取、写入excel文件
- Spring MVC 中的 forward 和 redirect
- HIVE1.1.0报错记录
- ipsec---icmp: ipsec中icmp的处理
- hdu 5204 Rikka with sequence && BestCoder Round #37
- LeetCode(055) Jump Game (Java)
- 在Java中利用Jackson解析JSON数据
- 03-SQLite3之insert、select、where
- 如何更优雅的书写Javascript之告别回调地狱
- Linux命令之ifconfig - 网络配置命令
- 编程之美 大神与三个小伙伴