hive升级到0.11的问题

来源:互联网 发布:淘宝v3会员消费多少钱 编辑:程序博客网 时间:2024/04/29 00:54

最近发现hive的0.11版本修改很大,其中解决了之前我碰到到一个使CPU100%的BUG(0.9版本是我自己改过的)

那么在使用0.11的时候,启动hive命令,出现了下面的错误:

13/07/31 10:31:15 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
Exception in thread "Main Thread" java.lang.NoSuchMethodError: org/apache/hadoop/hive/shims/ShimLoader.getEventCounter()Lorg/apache/log4j/AppenderSkeleton;
        at org.apache.hadoop.hive.shims.HiveEventCounter.<init>(HiveEventCounter.java:16)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at java.lang.Class.newInstance0(Class.java:355)
        at java.lang.Class.newInstance(Class.java:308)
        at org.apache.log4j.helpers.OptionConverter.instantiateByClassName(OptionConverter.java:330)
        at org.apache.log4j.helpers.OptionConverter.instantiateByKey(OptionConverter.java:121)
        at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:664)
        at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:647)
        at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:544)
        at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:440)
        at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:476)
        at org.apache.log4j.PropertyConfigurator.configure(PropertyConfigurator.java:354)
        at org.apache.hadoop.hive.common.LogUtils.initHiveLog4jDefault(LogUtils.java:124)
        at org.apache.hadoop.hive.common.LogUtils.initHiveLog4jCommon(LogUtils.java:77)
        at org.apache.hadoop.hive.common.LogUtils.initHiveLog4j(LogUtils.java:58)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:630)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

 

此问题描述很简单,就是ShimLoader类没有getEventCounter方法,

我修改了HiveEventCounter这个调用者将ShimLoader的所有方法打印出来,发现确实没有getEventCounter方法。

这两个类都在hive-exec-0.11.0.jar包的org.apache.hadoop.hive.shims路径下,奇怪的问题就是我将ShimLoader.class删除后,还是出现上面的错误,而不是说NoFoundClass这样的信息,非常诡异,目前还没有查到原因。

原创粉丝点击