记录MAVEN构建hadoop

来源：互联网发布：种子在线观看软件编辑：程序博客网时间：2024/06/14 04:04

关键的是将maven打包成jar，在hadoop中执行
在pom.xml增加如下内容

[html] view plain copy    <build>  <plugins>  <plugin>  <groupId>org.apache.maven.plugins</groupId>  <artifactId>maven-assembly-plugin</artifactId>  <version>2.3</version>  <configuration>      <appendAssemblyId>false</appendAssemblyId>      <descriptorRefs>          <descriptorRef>jar-with-dependencies</descriptorRef>      </descriptorRefs>      <archive>          <manifest>              <mainClass>danache.spiderInMaven.MinTemperature</mainClass>          </manifest>      </archive>  </configuration>  <executions>      <execution>          <id>make-assembly</id>          <phase>package</phase>          <goals>              <goal>assembly</goal>          </goals>      </execution>  </executions>  </plugin>    </plugins></build>  运行mvn assembly:assembly

第二种：

<plugin>      <groupId>org.apache.maven.plugins</groupId>      <artifactId>maven-jar-plugin</artifactId>      <version>2.4</version>      <configuration>          <archive>              <manifest>                  <addClasspath>true</addClasspath>                  <classpathPrefix>lib/</classpathPrefix>                  <mainClass>com.sysware.HelloWorld</mainClass>              </manifest>          </archive>      </configuration>  </plugin>

要加build，这个运行的是mvn clean package
之后在hadoop中直接
hadoop jar spiderInMaven-0.0.1-SNAPSHOT.jar /class5/temperature.txt /class5/out

0 0