Hadoop报错:Failed to locate the winutils binary in the hadoop binary path
来源:互联网 发布:sql数据库基础知识 编辑:程序博客网 时间:2024/06/11 13:44
1 发现问题
2 分析问题
打开源码,查看getQualifiedBinPath方法
3 解决问题
配置环境变量E:\\Program Files\\hadoop-2.7.0重启电脑。或者代码中设置System.setProperty("hadoop.home.dir", "E:\\Program Files\\hadoop-2.7.0");还有一种可能HADOOP_HOME的bin目录下根本没有winutils.exe,下载地址https://github.com/srccodes/hadoop-common-2.2.0-bin
在虚拟机中搭建了hadoop集群,在windows中通过代码访问报错
15/06/11 15:35:50 ERROR Shell: Failed to locate the winutils binary in the hadoop binary pathjava.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries. at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:356) at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:371) at org.apache.hadoop.util.Shell.<clinit>(Shell.java:364)
2 分析问题
打开源码,查看getQualifiedBinPath方法
public static final String getQualifiedBinPath(String executable) throws IOException { // construct hadoop bin path to the specified executable String fullExeName = HADOOP_HOME_DIR + File.separator + "bin" + File.separator + executable; File exeFile = new File(fullExeName); if (!exeFile.exists()) { throw new IOException("Could not locate executable " + fullExeName + " in the Hadoop binaries."); } return exeFile.getCanonicalPath(); } private static String HADOOP_HOME_DIR = checkHadoopHome();private static String checkHadoopHome() { // first check the Dflag hadoop.home.dir with JVM scope String home = System.getProperty("hadoop.home.dir"); // fall back to the system/user-global env variable if (home == null) { home = System.getenv("HADOOP_HOME"); } ...}exeFile不存在会报错,也就是fullExeName不存在。即windows中没有配置HADOOP_HOME。
3 解决问题
配置环境变量E:\\Program Files\\hadoop-2.7.0重启电脑。或者代码中设置System.setProperty("hadoop.home.dir", "E:\\Program Files\\hadoop-2.7.0");还有一种可能HADOOP_HOME的bin目录下根本没有winutils.exe,下载地址https://github.com/srccodes/hadoop-common-2.2.0-bin
原贴地址:http://www.cnblogs.com/hyl8218/p/5492450.html
1 0
- Hadoop报错:Failed to locate the winutils binary in the hadoop binary path
- 本地运行hadoop-Failed to locate the winutils binary in the hadoop binary path-转载
- 本地运行hadoop-Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- WIN7下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- win7系统下运行hadoop程序报:Failed to locate the winutils binary in the hadoop binary path
- Failed to locate the winutils binary in the hadoop binary path
- spark: ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
- 解决spark运行中ERROR Shell:Failed to locate the winutils binary in the hadoop binary path的问题
- Failed to locate the winutils binary in the hadoop binary path java.io.IOException: Could not locat
- IDEA开发Spark提示failed to locate the winutils binary in the hadoop binary
- 出现 ERROR org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary pa
- Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
- Could not locate executable null\bin\winutils.exe in the Hadoop binaries
- Could not locate executable null\bin\winutils.exe in the Hadoop binaries
- java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries
- java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries
- 说说JSON和JSONP
- while循环语句
- GOF设计模式之STATE(状态)
- JAVA中方法的调用【基础】
- 【AI每日播报】霍金:AI将让中产阶级大面积失业
- Hadoop报错:Failed to locate the winutils binary in the hadoop binary path
- 数据库索引
- SAP MM模块相关透明表收集
- [李景山php]每天TP5-20170108|thinkphp5-Model.php-1
- 基于jquery带有中国农历的日期插件
- “聂树斌冤案制造名单”已经流传
- 浅谈流形学习
- Java Web应用开发
- zabbix 模板和自定义键值