出现 ERROR org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary pa

来源：互联网发布：淘宝网怎么找货源编辑：程序博客网时间：2024/06/05 05:42

[2015-01-15 15:23:11,199] [main] (Shell.java:373) ERROR org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable D:\bin\hadoop-2.6.0\bin\winutils.exe in the Hadoop binaries.
   at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
   at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
   at org.apache.hadoop.util.Shell.<clinit>(Shell.java:363)
   at org.apache.hadoop.util.GenericOptionsParser.preProcessForWindows(GenericOptionsParser.java:438)
   at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:484)
   at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
   at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
   at hadoopTest.hadoop.Dedup.main(Dedup.java:66)
[2015-01-15 15:23:11,837] [main] (NativeCodeLoader.java:62) WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[2015-01-15 15:23:12,025] [main] (Configuration.java:1049) INFO org.apache.hadoop.conf.Configuration.deprecation - session.id is deprecated. Instead, use dfs.metrics.session-id
[2015-01-15 15:23:12,026] [main] (JvmMetrics.java:76) INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
Exception in thread "main" java.lang.NullPointerException
   at java.lang.ProcessBuilder.start(Unknown Source)
   at org.apache.hadoop.util.Shell.runCommand(Shell.java:482)
   at org.apache.hadoop.util.Shell.run(Shell.java:455)
   at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
   at org.apache.hadoop.util.Shell.execCommand(Shell.java:808)
   at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)
   at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:656)
   at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:444)
   at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:293)
   at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:133)
   at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:437)
   at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
   at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
   at java.security.AccessController.doPrivileged(Native Method)
   at javax.security.auth.Subject.doAs(Unknown Source)
   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
   at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
   at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1314)
   at hadoopTest.hadoop.Dedup.main(Dedup.java:107)

原因是缺少winutils.exe文件，在网上下载一个，这个问题就OK了

0 0