hadoop2.2.0配置eclipse运行wordcount程序问题及解决方法
来源:互联网 发布:web前端是编程嘛 编辑:程序博客网 时间:2024/06/06 14:27
问题1:空指针异常
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Exception in thread "main" java.lang.NullPointerException
at java.lang.ProcessBuilder.start(ProcessBuilder.java:441)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:404)
at org.apache.hadoop.util.Shell.run(Shell.java:379)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:678)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:661)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:639)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:435)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:277)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:125)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:344)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:562)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:557)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:557)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:548)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:833)
at test.WordCount.run(WordCount.java:150)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at test.WordCount.main(WordCount.java:155)
解决方法:
从https://github.com/srccodes/hadoop-common-2.2.0-bin上下载bin包,然后将bin目录下的winutils.exe放在hadoop/bin目录下或者将hadoop/bin目录文件全部替换为bin包,并且配置hadoop环境变量HADOOP_HOME="*****",在path中配置%HADOOP_HOME%\bin
问题2:文件IO异常
将第一步问题解决后继续运行程序,会出现如下问题:
Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z原因:缺少hadoop.dll文件
解决方案:
将bin包下的hadoop文件放在C:\Windows\System32目录下。
即可解决上面问题!!!Happy一把!!!
- hadoop2.2.0配置eclipse运行wordcount程序问题及解决方法
- eclipse hadoop1.2.0配置及wordcount运行
- hadoop2.7运行wordcount程序
- Hadoop2.6.4运行Wordcount程序
- 配置Hadoop2.x的HDFS、MapReduce来运行WordCount程序
- Ubuntu13.10 hadoop2.2.0 多机集群配置及wordcount 运行
- fedora17中hadoop2.2.0在eclipse下运行wordcount
- 在Hadoop2.2.0上运行Wordcount小程序
- CentOS+eclipse+hadoop2.5.1 运行wordcount
- eclipse配置hadoop开发环境并运行WordCount小程序
- Hadoop4Win + Eclipse 运行 WordCount 程序
- Hadoop4Win + Eclipse 运行 WordCount 程序
- Hadoop4Win + Eclipse 运行 WordCount 程序
- eclipse运行WordCount程序记录
- hadoop2.7.3 Windows eclipse开发环境搭建及WordCount实例运行
- eclipse运行wordcount参数配置
- eclipse运行wordcount参数配置
- Hadoop2.5.1 运行wordcount
- jsp中获取当前文件路径
- C# step by step 学习笔记8 CHAPTER 9 使用枚举和结构创建值类型
- 使用OFBIZ的理由和不使用OFBIZ的理由
- Google的技术领先业界多少年?
- 谷歌全球ip地址库
- hadoop2.2.0配置eclipse运行wordcount程序问题及解决方法
- 为程序员准备的7个国外社交网站
- JAVA线程池例子
- 杂记
- SUSE 11安装jdk1.7
- 第2次实验——算法基本功 与 综合思考
- java多线程(例子)
- win 8.1 vs2010使用CMake 2.8.1编译OpenCV2.4.4
- cygwin编译报错:**.cpp:1:1: error: stray '\377' in program解决方法