hadoop2.x编译（二）

3.工具安装

3.1.安装maven编译环境

3.1.1.解压缩maven到/usr/local/目录下

[root@hadoop software]# tar -zxvf apache-maven-3.3.3-bin.tar.gz -C /usr/local/

3.1.2.修改环境变量

[root@hadoop local]# vi /etc/profile

3.1.3.修改内容不够如下：

export  MAVEN_HOME=/usr/local/apache-maven-3.3.3

export  PATH=$PATH:$JAVA_HOME/bin:$MAVEN_HOME/bin

3.1.4.使修改的环境 变量生效

[root@hadoop local]# source /etc/profile

3.1.5.验证

[root@hadoop local]# mvn -version
Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06; 2015-04-22T04:57:37-07:00)
Maven home: /usr/local/apache-maven-3.3.3
Java version: 1.8.0_51, vendor: Oracle Corporation
Java home: /usr/local/jdk1.8.0_51/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-431.el6.x86_64", arch: "amd64", family: "unix"

3.1.6修改映像路径

修改影响路径主要是为了加快hadoop编译的速度及成功的概率。

http://maven.oschina.net/content/groups/public/

这个测试过，是目前国内可用映像地址，使用前请先拷到地址栏验证，如果显示 一个文件列表就是对的。

修改方法如下：

3.1.6.1打开文件路径：/usr/local/apache-maven-3.0.5/conf/settings.xml

3.1.6.2在mirrors节点下进行修改，内容如下：

<mirrors>

<mirror>

             <id>nexus</id>

               <mirrorOf>*</mirrorOf>

               <url>http://maven.oschina.net/content/groups/public/</url>

        </mirror>

</mirrors>

3.2.编译安装protobuf

3.2.1.解压缩protobuf到/usr/local/目录下

[root@hadoop software]# tar -zxvf protobuf-2.5.0.tar.gz -C /usr/local/

3.2.2.回到/usr/local目录下，创建protoc目录 sudo mkdir protoc

[root@hadoop local]# mkdir protoc

3.2.3.编译protoc

[root@hadoop local]# cd protobuf-2.5.0/

[root@hadoop protobuf-2.5.0]# ./configure --prefix=/usr/local/protoc/

... ...

[root@hadoop protobuf-2.5.0]# make

... ...

[root@hadoop protobuf-2.5.0]# make install

... ...

整个过程没有报错即为成功。

3.2.4检查

[root@hadoop protobuf-2.5.0]# cd ..
[root@hadoop local]# cd protoc/
[root@hadoop protoc]# ll
total 12
drwxr-xr-x. 2 root root 4096 Aug 30 00:04 bin
drwxr-xr-x. 3 root root 4096 Aug 30 00:04 include
drwxr-xr-x. 3 root root 4096 Aug 30 00:04 lib

3.2.5.配置环境变量

[root@hadoop local]# vi /etc/profile

3.2.6.添加如下内容

export  LD_LIBRARY_PATH=/usr/local/protoc
export  PATH=$PATH:$JAVA_HOME/bin:$MAVEN_HOME/bin:$LD_LIBRARY_PATH/bin

3.2.7.使环境变量生效

[root@hadoop protoc]# source /etc/profile

3.2.8.验证

[root@hadoop protoc]# protoc --version
libprotoc 2.5.0

3.3安装ant

3.3.1.解压缩ant到/usr/local/目录下

[root@hadoop software]# tar -zxvf apache-ant-1.9.4-bin.tar.gz -C /usr/local/

3.3.2.配置环境变量

[root@hadoop local]# vi /etc/profile

添加如下内容，注意PATH变量是在原来的基础上修改。

export ANT_HOME=/usr/local/apache-ant-1.9.4

export PATH=$PATH:$JAVA_HOME/bin:$MAVEN_HOME/bin:$LD_LIBRARY_PATH/bin:$ANT_HOME/bin

3.3.3.使环境变量生效

[root@hadoop local]# source /etc/profile

3.3.4.验证

[root@hadoop local]# ant -version
Apache Ant(TM) version 1.9.4 compiled on April 29 2014

3.4.安装findbugs

3.4.1.解压findbugs到/usr/local/目录下

[root@hadoop software]# tar -zxvf findbugs-2.0.3.tar.gz -C /usr/local/

3.4.2.配置环境变量

[root@hadoop local]# vi /etc/profile

3.4.3.添加如下内容

export  FINDBUGS_HOME=/usr/local/findbugs-2.0.3
export  PATH=$PATH:$JAVA_HOME/bin:$MAVEN_HOME/bin:$LD_LIBRARY_PATH/bin:$ANT_HOME/bin:$FINDBUGS_HOME/bin

3.4.4.使环境变量生效

[root@hadoop protoc]# source /etc/profile

3.4.5.验证

[root@hadoop local]# findbugs -version
2.0.3

4.编译hadoop

4.1.解压hadoop文件到/usr/local目录下

[root@hadoop software]# tar -zxvf hadoop-2.7.1-src.tar.gz -C /usr/local/

4.2.修改配置

4.2.1.进入/usr/local/hadoop-2.7.1-src/

[root@hadoop local]# cd hadoop-2.7.1-src/

[root@hadoop hadoop-2.7.1-src]# ll

total 112
-rw-r--r--.  1 root root 13110 Jun 28 23:03 BUILDING.txt
drwxr-xr-x.  2 root root  4096 Aug 30 01:13 dev-support
drwxr-xr-x.  3 root root  4096 Aug 30 01:13 hadoop-assemblies
drwxr-xr-x.  2 root root  4096 Aug 30 01:13 hadoop-client
drwxr-xr-x. 10 root root  4096 Aug 30 01:12 hadoop-common-project
drwxr-xr-x.  2 root root  4096 Aug 30 01:13 hadoop-dist
drwxr-xr-x.  6 root root  4096 Aug 30 01:12 hadoop-hdfs-project
drwxr-xr-x.  9 root root  4096 Aug 30 01:13 hadoop-mapreduce-project
drwxr-xr-x.  3 root root  4096 Aug 30 01:13 hadoop-maven-plugins
drwxr-xr-x.  2 root root  4096 Aug 30 01:13 hadoop-minicluster
drwxr-xr-x.  3 root root  4096 Aug 30 01:13 hadoop-project
drwxr-xr-x.  2 root root  4096 Aug 30 01:12 hadoop-project-dist
drwxr-xr-x. 16 root root  4096 Aug 30 01:13 hadoop-tools
drwxr-xr-x.  3 root root  4096 Aug 30 01:13 hadoop-yarn-project
-rw-r--r--.  1 root root 15429 Jun 28 23:03 LICENSE.txt
-rw-r--r--.  1 root root   101 Jun 28 23:03 NOTICE.txt
-rw-r--r--.  1 root root 18893 Jun 28 23:03 pom.xml
-rw-r--r--.  1 root root  1366 Jun 28 23:03 README.txt

4.2.2.Hadoop环境参数配置

编辑源代码根目录下的pom.xml

找到<artifactId>maven-antrun-plugin</artifactId>，修改内容如下

    <plugin>
          <groupId>org.apache.maven.plugins</groupId>
          <artifactId>maven-antrun-plugin</artifactId>
          <version>${maven-antrun-plugin.version}</version>
          <dependencies>
            <dependency>
                  <groupId>org.codehaus.plexus</groupId>
                  <artifactId>plexus-utils</artifactId>
                  <version>2.0.5</version>
              </dependency>
              <dependency>
                    <groupId>org.apache.ant</groupId>
                     <artifactId>ant</artifactId>
                     <version>1.9.4</version>
                </dependency>
           </dependencies>
     </plugin>

粗体部分为需要添加的内容