windows搭建hadoop集群的一系列错误

来源：互联网发布：淘宝卖家怎么设置公益编辑：程序博客网时间：2024/06/05 18:15

1.最恶心我的错误

$ bin/hadoop jar hadoop-0.19.2-examples.jar wordcount in out

10/07/15 04:19:08 INFO mapred.FileInputFormat: Total input paths to process : 1
10/07/15 04:19:10 INFO mapred.JobClient: Running job: job_201007150342_0006
10/07/15 04:19:11 INFO mapred.JobClient:  map 0% reduce 0%
10/07/15 04:19:33 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_0, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_0/work/tmp
oes not exist.
        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy
tem.java:420)
        at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem
java:244)
        at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520

        at org.apache.hadoop.mapred.Child.main(Child.java:143)

10/07/15 04:19:43 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_1, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_1/work/tmp
oes not exist.
        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy
tem.java:420)
        at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem
java:244)
        at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:520

        at org.apache.hadoop.mapred.Child.main(Child.java:143)

10/07/15 04:19:52 INFO mapred.JobClient: Task Id : attempt_201007150342_0006_m_
00003_2, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTrack
r/jobcache/job_201007150342_0006/attempt_201007150342_0006_m_000003_2/work/tmp

oes not exist.

解决办法：设置一下缓存就可以了，在mapred-site.xml 修改
<property>
<name>mapred.child.tmp</name>
<value>/hadoop/run/temp</value>
</property>