CentOS6.7-64bit编译hadoop2.6.4

来源:互联网 发布:网络推手兼职平台 编辑:程序博客网 时间:2024/05/25 05:37
1.下载maven(apache-maven-3.3.3-bin.tar.gz)http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz2.安装maventar -zxvf apache-maven-3.3.3-bin.tar.gz -C /usr/local3.添加环境变量vim /etc/profileexport JAVA_HOME=/usr/local/jdk1.7.0_45export MAVEN_HOME=/usr/local/apache-maven-3.3.3export PATH=$PATH:$JAVA_HOME/bin:$MAVEN_HOME/bin4.加载环境变量source /etc/profliemvn -version5.下载protobuf(https://code.google.com/p/protobuf/downloads/list 或 https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz)6.安装protobuf编译依赖,为了编译安装protoc,需要使用YUM下载几个依赖的工具yum install -y gcc gcc-c++ make7.解压安装protobuftar -zxvf protobuf-2.5.0.tar.gz -C /usr/local/srccd /usr/local/src/protobuf-2.5.0 ./configure --prefix=/usr/local/protobuf make && make install8将protobuf添加到环境变量vim /etc/profileexport PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$MAVEN_HOME/bin:/usr/local/protobuf/binsource /etc/profileprotoc --version9.安装其他编译依赖yum install -y cmake openssl-devel ncurses-devel zlib-develyum install -y snappy snappy-devel bzip2 bzip2-devel lzo lzo-devel lzop openssl openssl-devel10.编译hadoop(进入文件夹里面,里面有一个文件BUILDINT.txt,打开即可看见里面关于编译hadoop的一些环境要求)tar -zxvf hadoop-2.6.4-src.tar.gz -C /usr/local/src/cd /usr/local/src/hadoop-2.6.4-srcmvn package -Pdist,native -DskipTests -Dtar 12.查看编译好的安装包cd /usr/local/src/hadoop-2.6.4-src/hadoop-dist/target#出现问题INFO util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable在/etc/profile中添加export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib/native"#查看可用的本地库hadoop checknative -a