64位Ubuntu14.04编译hadoop2.6
来源:互联网 发布:带端口号的ping 编辑:程序博客网 时间:2024/04/30 06:22
编译前准备
hadoop-2.6.0-src.zip
maven
JDK7(注意,需要是JDK7,JDK8因为兼容性问题无法编译成功)开始编译
安装JDK
安装方法请参见: http://my.oschina.net/u/2282865/blog/395739
安装maven
sudo apt-get install maven mvn --version
安装依赖库
sudo apt-get install g++ autoconf automake libtool cmake zlib1g-dev pkg-config libssl-dev
sudo apt-get install openssh-server
安装protoc
sudo apt-get install protobuf-compilerprotoc --version
开始编译,进入HADOOP源代码目录 hadoop-2.6.0-src,执行:
mvn clean package -Pdist,native -DskipTests -Dtar
[INFO] ------------------------------------------------------------------------[INFO] Reactor Summary:[INFO] [INFO] Apache Hadoop Main ................................ SUCCESS [1.205s][INFO] Apache Hadoop Project POM ......................... SUCCESS [1.187s][INFO] Apache Hadoop Annotations ......................... SUCCESS [2.856s][INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.256s][INFO] Apache Hadoop Project Dist POM .................... SUCCESS [1.726s][INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [2.863s][INFO] Apache Hadoop MiniKDC ............................. SUCCESS [3.064s][INFO] Apache Hadoop Auth ................................ SUCCESS [4.360s][INFO] Apache Hadoop Auth Examples ....................... SUCCESS [3.036s][INFO] Apache Hadoop Common .............................. SUCCESS [1:35.206s][INFO] Apache Hadoop NFS ................................. SUCCESS [7.385s][INFO] Apache Hadoop KMS ................................. SUCCESS [11.518s][INFO] Apache Hadoop Common Project ...................... SUCCESS [0.037s][INFO] Apache Hadoop HDFS ................................ SUCCESS [2:17.988s][INFO] Apache Hadoop HttpFS .............................. SUCCESS [15.917s][INFO] Apache Hadoop HDFS BookKeeper Journal ............. SUCCESS [8:54.814s][INFO] Apache Hadoop HDFS-NFS ............................ SUCCESS [3.273s][INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.039s][INFO] hadoop-yarn ....................................... SUCCESS [0.029s][INFO] hadoop-yarn-api ................................... SUCCESS [1:21.677s][INFO] hadoop-yarn-common ................................ SUCCESS [2:04.882s][INFO] hadoop-yarn-server ................................ SUCCESS [0.040s][INFO] hadoop-yarn-server-common ......................... SUCCESS [59.159s][INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [2:39.110s][INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [2.738s][INFO] hadoop-yarn-server-applicationhistoryservice ...... SUCCESS [5.060s][INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [16.724s][INFO] hadoop-yarn-server-tests .......................... SUCCESS [4.537s][INFO] hadoop-yarn-client ................................ SUCCESS [6.404s][INFO] hadoop-yarn-applications .......................... SUCCESS [0.031s][INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [2.486s][INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SUCCESS [1.715s][INFO] hadoop-yarn-site .................................. SUCCESS [0.060s][INFO] hadoop-yarn-registry .............................. SUCCESS [4.597s][INFO] hadoop-yarn-project ............................... SUCCESS [4.524s][INFO] hadoop-mapreduce-client ........................... SUCCESS [0.053s][INFO] hadoop-mapreduce-client-core ...................... SUCCESS [20.050s][INFO] hadoop-mapreduce-client-common .................... SUCCESS [15.055s][INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [3.437s][INFO] hadoop-mapreduce-client-app ....................... SUCCESS [8.152s][INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [6.760s][INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [54.547s][INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [1.622s][INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [4.799s][INFO] hadoop-mapreduce .................................. SUCCESS [4.062s][INFO] Apache Hadoop MapReduce Streaming ................. SUCCESS [15.407s][INFO] Apache Hadoop Distributed Copy .................... SUCCESS [36.599s][INFO] Apache Hadoop Archives ............................ SUCCESS [2.880s][INFO] Apache Hadoop Rumen ............................... SUCCESS [5.047s][INFO] Apache Hadoop Gridmix ............................. SUCCESS [4.041s][INFO] Apache Hadoop Data Join ........................... SUCCESS [2.439s][INFO] Apache Hadoop Ant Tasks ........................... SUCCESS [2.007s][INFO] Apache Hadoop Extras .............................. SUCCESS [2.676s][INFO] Apache Hadoop Pipes ............................... SUCCESS [9.342s][INFO] Apache Hadoop OpenStack support ................... SUCCESS [4.124s][INFO] Apache Hadoop Amazon Web Services support ......... SUCCESS [15:56.705s][INFO] Apache Hadoop Client .............................. SUCCESS [6.766s][INFO] Apache Hadoop Mini-Cluster ........................ SUCCESS [0.111s][INFO] Apache Hadoop Scheduler Load Simulator ............ SUCCESS [5.307s][INFO] Apache Hadoop Tools Dist .......................... SUCCESS [21.215s][INFO] Apache Hadoop Tools ............................... SUCCESS [0.024s][INFO] Apache Hadoop Distribution ........................ SUCCESS [40.475s][INFO] ------------------------------------------------------------------------[INFO] BUILD SUCCESS[INFO] ------------------------------------------------------------------------[INFO] Total time: 42:16.388s[INFO] Finished at: Fri Jan 30 16:30:42 CST 2015[INFO] Final Memory: 148M/691M[INFO] ------------------------------------------------------------------------
前面说过,如果JDK版本是1.8的话会编译失败:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.8.1:jar (module-javadocs) on project hadoop-maven-plugins: MavenReportException: Error while creating archive:
sudo update-alternatives --config java sudo update-alternatives --config javac sudo update-alternatives --config javadoc sudo update-alternatives --config javah
0 0
- 64位Ubuntu14.04编译hadoop2.6
- ubuntu14.04中编译Hadoop2.6.0 64位版本
- Ubuntu14下Hadoop开发<2> 编译64位Hadoop2.4
- 32位ubuntu14.04手动编译hadoop2.6.0
- 32位ubuntu14.04手动编译hadoop2.6.0
- 32位ubuntu14.04手动编译hadoop2.6.0
- Ubuntu14.04下Hadoop2.6源码编译
- hadoop2.6编译过程(64位)
- CentOS 64位编译Hadoop2.6源码
- 64位Ubuntu14.04下安装hadoop2.6单机配置和伪分布配置详解
- Hadoop2.X 64位编译
- Hadoop2.X 64位编译
- 在Ubuntu12.04 64位上编译hadoop2.2.0
- 在64位ubuntu16.04下编译hadoop2.8.1
- Ubuntu14(64位) 集群环境下安装Hadoop2.4
- hadoop2.2.0编译--centos6.4-64位
- CentOS 64位上编译 Hadoop2.6.0
- CentOS 7 编译64位Hadoop2.7.1
- UML之用例图【概念、关系、例子】
- 仿手机QQ列表支持下拉,上滑,滑动删除
- windows 下python包管理工具pip的安装与使用
- Android Studio 快捷键(最全)
- Python学习笔记-Python的字符串,格式化,条件判断,循环、raw_input的注意事项
- 64位Ubuntu14.04编译hadoop2.6
- 百度绿萝算法是什么?-成都网页设计
- parkour -2
- Java代码生成图片验证码实现
- 《C++编程》第二章第18题
- poj 3111 K Best 参数搜索之牛顿迭代法
- Android学习之路
- ARM汇编程序鉴赏(1)
- 黑马程序员——OC语言——继承