Hadoop 3.0.0 版本编译导入eclipse

1)下载压缩包

   http://www.trieuvan.com/apache/hadoop/common/hadoop-3.0.0-alpha1/hadoop-3.0.0-alpha1-src.tar.gz

2)解压(解压的过程中会遇到无法创建文件，这个时候时候不用处理，不是问题)

3)通过maven命令获取源码

显示如下结果信息：

$ mvn install -e -U[INFO] Error stacktraces are turned on.[INFO] Scanning for projects...[INFO][INFO] ------------------------------------------------------------------------[INFO] Building Apache Hadoop Maven Plugins 3.0.0-alpha1[INFO] ------------------------------------------------------------------------[INFO][INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-maven-plugins ---[INFO] Executing tasksmain:[INFO] Executed tasks[INFO][INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hadoop-maven-plugins ---[INFO][INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-maven-plugins ---[INFO] Using 'UTF-8' encoding to copy filtered resources.[INFO] skip non existing resourceDirectory D:\workspace\source_code\hadoop\hadoop-3.0.0-alpha1-src\hadoop-maven-plugins\src\main\resources[INFO] Copying 2 resources[INFO][INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-maven-plugins ---[INFO] Nothing to compile - all classes are up to date[INFO][INFO] --- maven-plugin-plugin:3.4:descriptor (default-descriptor) @ hadoop-maven-plugins ---[INFO] Using 'UTF-8' encoding to read mojo metadata.[INFO] Mojo extractor with id: java-javadoc found 0 mojo descriptors.[INFO] Mojo extractor with id: java-annotations found 4 mojo descriptors.[INFO][INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-maven-plugins ---[INFO] Using 'UTF-8' encoding to copy filtered resources.[INFO] skip non existing resourceDirectory D:\workspace\source_code\hadoop\hadoop-3.0.0-alpha1-src\hadoop-maven-plugins\src\test\resources[INFO] Copying 2 resources[INFO][INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-maven-plugins ---[INFO] No sources to compile[INFO][INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-maven-plugins ---[INFO][INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-maven-plugins ---[INFO] Building jar: D:\workspace\source_code\hadoop\hadoop-3.0.0-alpha1-src\hadoop-maven-plugins\target\hadoop-maven-plugins-3.0.0-alpha1.jar[INFO][INFO] --- maven-plugin-plugin:3.4:addPluginArtifactMetadata (default-addPluginArtifactMetadata) @ hadoop-maven-plugins ---[INFO][INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ hadoop-maven-plugins ---[INFO][INFO] --- maven-enforcer-plugin:1.4.1:enforce (depcheck) @ hadoop-maven-plugins ---[INFO][INFO] --- maven-install-plugin:2.5.1:install (default-install) @ hadoop-maven-plugins ---[INFO] Installing D:\workspace\source_code\hadoop\hadoop-3.0.0-alpha1-src\hadoop-maven-plugins\target\hadoop-maven-plugins-3.0.0-alpha1.jar to C:\Users\zhuhailong\.m2\repository\org\apache\hadoop\hadoop-maven-plugins\3.0.0-alpha1\hadoop-maven-plugins-3.0.0-alpha1.jar[INFO] Installing D:\workspace\source_code\hadoop\hadoop-3.0.0-alpha1-src\hadoop-maven-plugins\pom.xml to C:\Users\zhuhailong\.m2\repository\org\apache\hadoop\hadoop-maven-plugins\3.0.0-alpha1\hadoop-maven-plugins-3.0.0-alpha1.pom[INFO] ------------------------------------------------------------------------[INFO] BUILD SUCCESS[INFO] ------------------------------------------------------------------------[INFO] Total time: 10.776 s[INFO] Finished at: 2016-10-20T15:34:22+08:00[INFO] Final Memory: 27M/268M[INFO] ------------------------------------------------------------------------

4)通过maven命令生成eclipse项目文件

mvn eclipse:eclipse -DskipTests

显示如下结果信息：

[INFO] Reactor Summary:[INFO][INFO] Apache Hadoop Main ................................. SUCCESS [  1.489 s][INFO] Apache Hadoop Build Tools .......................... SUCCESS [  0.426 s][INFO] Apache Hadoop Project POM .......................... SUCCESS [  0.882 s][INFO] Apache Hadoop Annotations .......................... SUCCESS [  0.247 s][INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [  0.212 s][INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.155 s][INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [  2.289 s][INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  0.884 s][INFO] Apache Hadoop Auth ................................. SUCCESS [  1.311 s][INFO] Apache Hadoop Auth Examples ........................ SUCCESS [  0.756 s][INFO] Apache Hadoop Common ............................... SUCCESS [  2.502 s][INFO] Apache Hadoop NFS .................................. SUCCESS [  1.802 s][INFO] Apache Hadoop KMS .................................. SUCCESS [  2.211 s][INFO] Apache Hadoop Common Project ....................... SUCCESS [  0.153 s][INFO] Apache Hadoop HDFS Client .......................... SUCCESS [  2.087 s][INFO] Apache Hadoop HDFS ................................. SUCCESS [  0.976 s][INFO] Apache Hadoop HDFS Native Client ................... SUCCESS [  1.372 s][INFO] Apache Hadoop HttpFS ............................... SUCCESS [  2.358 s][INFO] Apache Hadoop HDFS BookKeeper Journal .............. SUCCESS [  1.322 s][INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [  0.704 s][INFO] Apache Hadoop HDFS Project ......................... SUCCESS [  0.087 s][INFO] Apache Hadoop YARN ................................. SUCCESS [  0.084 s][INFO] Apache Hadoop YARN API ............................. SUCCESS [  0.390 s][INFO] Apache Hadoop YARN Common .......................... SUCCESS [  1.707 s][INFO] Apache Hadoop YARN Server .......................... SUCCESS [  0.075 s][INFO] Apache Hadoop YARN Server Common ................... SUCCESS [  1.108 s][INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [  1.023 s][INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [  1.122 s][INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [  1.025 s][INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [  6.046 s][INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [  4.616 s][INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [  2.937 s][INFO] Apache Hadoop YARN Client .......................... SUCCESS [  1.801 s][INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [  1.785 s][INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [  1.819 s][INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [  6.794 s][INFO] Apache Hadoop YARN Applications .................... SUCCESS [  0.084 s][INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [  1.144 s][INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [  0.879 s][INFO] Apache Hadoop YARN Site ............................ SUCCESS [  0.068 s][INFO] Apache Hadoop YARN Registry ........................ SUCCESS [  0.597 s][INFO] Apache Hadoop YARN Project ......................... SUCCESS [  1.731 s][INFO] Apache Hadoop MapReduce Client ..................... SUCCESS [  0.227 s][INFO] Apache Hadoop MapReduce Core ....................... SUCCESS [  2.530 s][INFO] Apache Hadoop MapReduce Common ..................... SUCCESS [  1.235 s][INFO] Apache Hadoop MapReduce Shuffle .................... SUCCESS [  1.108 s][INFO] Apache Hadoop MapReduce App ........................ SUCCESS [  1.695 s][INFO] Apache Hadoop MapReduce HistoryServer .............. SUCCESS [  1.662 s][INFO] Apache Hadoop MapReduce JobClient .................. SUCCESS [  1.797 s][INFO] Apache Hadoop MapReduce HistoryServer Plugins ...... SUCCESS [  0.758 s][INFO] Apache Hadoop MapReduce NativeTask ................. SUCCESS [  0.876 s][INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [  2.422 s][INFO] Apache Hadoop MapReduce ............................ SUCCESS [  0.255 s][INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [  1.712 s][INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [  0.348 s][INFO] Apache Hadoop Archives ............................. SUCCESS [  0.460 s][INFO] Apache Hadoop Archive Logs ......................... SUCCESS [  1.139 s][INFO] Apache Hadoop Rumen ................................ SUCCESS [  1.575 s][INFO] Apache Hadoop Gridmix .............................. SUCCESS [  0.659 s][INFO] Apache Hadoop Data Join ............................ SUCCESS [  0.451 s][INFO] Apache Hadoop Extras ............................... SUCCESS [  0.591 s][INFO] Apache Hadoop Pipes ................................ SUCCESS [  0.108 s][INFO] Apache Hadoop OpenStack support .................... SUCCESS [  0.887 s][INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [  1.574 s][INFO] Apache Hadoop Azure support ........................ SUCCESS [  0.820 s][INFO] Apache Hadoop Client ............................... SUCCESS [  2.713 s][INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [  1.884 s][INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [  5.129 s][INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [  2.810 s][INFO] Apache Hadoop Tools Dist ........................... SUCCESS [  1.930 s][INFO] Apache Hadoop Kafka Library support ................ SUCCESS [  0.794 s][INFO] Apache Hadoop Tools ................................ SUCCESS [  0.064 s][INFO] Apache Hadoop Distribution ......................... SUCCESS [  0.216 s][INFO] ------------------------------------------------------------------------[INFO] BUILD SUCCESS[INFO] ------------------------------------------------------------------------[INFO] Total time: 01:45 min[INFO] Finished at: 2016-10-20T15:33:38+08:00[INFO] Final Memory: 139M/727M[INFO] ------------------------------------------------------------------------

5)将项目导入到eclipse中即可

在导入到eclipse后，会遇到如下几个问题：

第一个问题：

AvroRecord cannot be resolved to a typeTestAvroSerialization.java /hadoop-common/src/test/java/org/apache/hadoop/io/serializer/avro1.下载avro-tool-1.7.7.jar http://mvnrepository.com/artifact/org.apache.avro/avro-tools/1.7.72.执行如下命令：Java -jar /xxx/avro-tool-1.7.7.jar compile schema /xxx/hadoop-common-project/hadoop-common/src/test/avro/avroRecord.avsc ../java  其中avsc文件是avro的模式文件，上面命令的作用是将模式文件生成相应的.java文件

第二个问题：

EchoRequestProto cannot be resolvedRPCCallBenchmark.java/hadoop-common/src/test/java/org/apache/hadoop/ipc执行如下命令：cd hadoop-common-project\hadoop-common\src\test\proto protoc --java_out=..\java

第三个问题：

Project 'hadoop-streaming' is missing required source folder如下图：删除报错的路径，然后重新引入

最后如下：