hbase.mapred.TableMapReduceUtil.initCredentials
来源:互联网 发布:linux怎么复制命令 编辑:程序博客网 时间:2024/05/22 00:55
今天遇到一个问题,(Hive 0.9.0 和 hbase0.93.3)
hive与hbase进行关联的时候,hbase录入的数据,但是select hive中的表示,提示如下错误:
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hbase.mapred.TableMapReduceUtil.initCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
at org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:419)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:281)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:320)
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:154)
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1377)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
hive和hbase版本不兼容问题,使用
hive版本查看
#ls /usr/local/hive/lib/
hbase版本查看
#hbase shell
>version
测试命令
#hive
>CREATE TABLE hbase_table_1(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" = "hbase_fudk");
#hbase shell
>list
>describe 'hbase_fudk'
>put 'hbase_fudk','0000000001','cf1:val','www.aboutyun.com'
>scan 'hbase_fudk'
>exit
#hive
>select * from hbase_table_1;
hive与hbase进行关联的时候,hbase录入的数据,但是select hive中的表示,提示如下错误:
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hbase.mapred.TableMapReduceUtil.initCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
at org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:419)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:281)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:320)
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:154)
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1377)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
hive和hbase版本不兼容问题,使用
hbase-0.94.7 和 hive-0.9.0 就可以了
进入/usr/local/hive/lib/ 可以看到hbase的信息,使用此版本的即可。hive版本查看
#ls /usr/local/hive/lib/
hbase版本查看
#hbase shell
>version
测试命令
#hive
>CREATE TABLE hbase_table_1(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" = "hbase_fudk");
#hbase shell
>list
>describe 'hbase_fudk'
>put 'hbase_fudk','0000000001','cf1:val','www.aboutyun.com'
>scan 'hbase_fudk'
>exit
#hive
>select * from hbase_table_1;
0 0
- hbase.mapred.TableMapReduceUtil.initCredentials
- Hadoop MapReduce操作Hbase范例学习(TableMapReduceUtil)
- 如何使用mapred export import删除hbase表数据
- hbase的mapreduce: mapreduce未执行;WARN mapred.LocalJobRunner: job_local_0001
- TableMapReduceUtil工具类
- hadoop mapred
- MapRed Hello World
- google论文--mapred中文翻译
- mapred.output.compression.codec
- hadoop参数-hdfs-mapred
- mapred.min.split.size
- mapred-site.xml
- MapRed编程自定义Partitioner
- mapred job kill
- hadoop参数-hdfs-mapred
- hadoop/mapred优化方法.V002
- org.apache.hadoop.mapred.FileAlreadyExistsException
- hadoop mapred-queue-acls 配置
- 19. Remove Nth Node From End of List
- Navicat for mysql 远程连接mysql数据库问题 1130报错
- svn服务器搭建
- (转载)RCNN,SPPNet,Fast_RCNN,Faster_RCNN
- linux系统查看内存使用率
- hbase.mapred.TableMapReduceUtil.initCredentials
- CodeForces - 660A Co-prime Array (模拟)
- 配置hadoop-1.2.1 eclipse开发环境 Run as hadoop
- eclipse hadoop设置报错 9000 failed on connection exception
- CentOS-6.3系统下Ganglia-3.6.0监控集群安装配置实践
- hadoop安装的时候,提前确认hadoop版本是32位还是64位。
- Linux 防火墙开放特定端口 (iptables)
- SAP SYBASE16数据库恢复
- 60、undefined与null的区别