hadoop 中hive查询表时出现无法使用mayreduce job任务 错误

来源:互联网 发布:2014年上证指数数据 编辑:程序博客网 时间:2024/04/28 03:08

   hadoop中使用hive+mysql 对表进行查询时,只能全表查询,不能对查询显示部分列。希望大虾们能给出解决办法,具体如下:

   1 使用 select * from student;           正常

 hive> select * from student;
OK
1    lisi    computer    034
2    zhangsan    computer    034
3    wangwu    computer    034
4    zhaoliu    computer    034
5    wangli    computer    034
6    wangliying    computer    034
7    wp    physics    034
8    zxm    physics    034
9    ljz    physics    034
10    cds    physics    034
11    mac    physics    034
12    android    physics    034
13    symbian    physics    034
14    wp    physics    034
Time taken: 0.749 seconds

 2 使用hive> select id,name from student;   异常

 报错如下:

  Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
java.io.FileNotFoundException: File1 file:/home/GuoYunling-Andy/hadoop/hive/hive-0.9.0/lib/hbase-0.92.0.jar  does not exist.
    at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:407)
    at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
    at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:213)
    at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:163)
    at org.apache.hadoop.mapred.JobClient.copyRemoteFiles(JobClient.java:627)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:730)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
    at org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
    at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:435)
    at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:137)
    at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
    at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
    at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
    at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:601)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Job Submission failed with exception 'java.io.FileNotFoundException(File1 file:/home/GuoYunling-Andy/hadoop/hive/hive-0.9.0/lib/hbase-0.92.0.jar  does not exist. )'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask

希望大虾们能帮忙解决下!