hadoop 在windows下安装配置文章一篇

来源:互联网 发布:苏格兰 知乎 编辑:程序博客网 时间:2024/06/05 08:04

http://ebiquity.umbc.edu/Tutorials/Hadoop/00%20-%20Intro.html

国外的,相当强大,主要是配图很详实

 

但是我照着弄还是出了点问题,用的是0.20.2版本

提示CastException:

org.apache.hadoop.mapreduce.lib.input.FileSplit cannot be cast to mapred.InputSplit

 

另外,用自带的eclipse插件运行根本没反应,用了一个IBM网站找的,又不会用..

http://www.alphaworks.ibm.com/tech/mapreducetools/download

 

话说在ubuntu下又是另一个问题,NullPointerException,找了下,摘抄一段答疑文字如下,未解决,网上一般认为是版本和hosts的设置问题

 

Have you looked at https://issues.apache.org/jira/browse/MAPREDUCE-969 ?
It points to https://issues.apache.org/jira/browse/HADOOP-4744
See if HADOOP-4744 is contained in the hadoop version you're running.
I am reading cdh3b2 source code. Please confirm that *ReduceTask.java:2683 *is
this line:
List loc = mapLocations.get(host);
If so, you can print the value of host, or value of URI u which host is
derived.
Cheers