hadoop cdh4 eclipse plugin
来源:互联网 发布:清华网络教育 编辑:程序博客网 时间:2024/06/05 04:55
参考了很多mapre1 插件生成文档,大部分都是hadoop标准版本的,这里给个CDH4的,仅供参考。
switch (state) { // case JobStatus.PREP: case 4: return PREPARE; // case JobStatus.RUNNING: case 1: return RUNNING; // case JobStatus.FAILED: case 3: return FAILED; // case JobStatus.SUCCEEDED: case 2: return SUCCEEDED; default: return null; } }
参考了标准hadoop生成流程:http://m.blog.csdn.net/blog/u010415792/8976261
1)download eclipse
2)解压 eclipse
3)安装与配置 Ant 修 改 /etc/profile 文件
export ANT_HOME=[path]/apache-ant-1.7.1
export PATH=$PATH$:$ANT_HOME/bin
source /etc/profile
4)安装 JDK 1.6 以上版本
5)hadoop-2.0.0-cdh4.6.0/src/hadoop-mapreduce1-project/src/contrib/eclipse-plugin/build.properties
增加
eclipse.home=[path]/eclipse
reactor.repo=https://repository.cloudera.com/content/repositories/snapshots
version=2.0.0-cdh4.4.0
参考:http://stackoverflow.com/questions/18852338/ant-build-for-eclipse-cant-resolve-log4j
否则会有提示:
[ivy:resolve] :: commons-logging#commons-logging;1.1.1: several problems occurred while resolving dependency: commons-logging#commons-logging;1.1.1 {common=[default]}:[ivy:resolve] reactor-repo: unable to get resource for commons-logging#commons-logging;1.1.1: res=${reactor.repo}/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.pom[ivy:resolve] several problems occurred while resolving dependency: org.apache.commons#commons-parent;5 {}:[ivy:resolve] reactor-repo: unable to get resource for org/apache/commons#commons-parent;5: res=${reactor.repo}/org/apache/commons/commons-parent/5/commons-parent-5.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/apache/commons/commons-parent/5/commons-parent-5.pom[ivy:resolve] several problems occurred while resolving dependency: org.apache#apache;4 {}:[ivy:resolve] reactor-repo: unable to get resource for org/apache#apache;4: res=${reactor.repo}/org/apache/apache/4/apache-4.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/apache/apache/4/apache-4.pom[ivy:resolve] reactor-repo: unable to get resource for org/apache#apache;4: res=${reactor.repo}/org/apache/apache/4/apache-4.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/apache/apache/4/apache-4.jar[ivy:resolve] :: log4j#log4j;1.2.16: several problems occurred while resolving dependency: log4j#log4j;1.2.16 {common=[master]}:[ivy:resolve] reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.pom[ivy:resolve] reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::[ivy:resolve] [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
6)hadoop-2.0.0-cdh4.6.0/src/hadoop-mapreduce1-project/src/contrib/eclipse-plugin/build-contrib.xml
增加
<project name="hadoopbuildcontrib" xmlns:ivy="antlib:org.apache.ivy.ant"> <property name="eclipse.home"location="C:\eclipse"/> --添加部分 <property name="version" value="1.0.4"/> --添加部分 <property name="name" value="${ant.project.name}"/> <property name="root" value="${basedir}"/> <property name="hadoop.root" location="${root}/../../../"/>
7)修改${HADOOP_HOME}/src/contrib/eclipse-plugin/build.xml文件
<fileset dir="[path to lib of mapreduce1]"> --添加部分直接全路径吧,这是示例:<fileset dir="./share/hadoop/mapreduce1/lib/"><include name="hadoop*.jar"/> --添加部分</fileset> --添加部分
注:如还有缺少,继续添加其他包的引入
8)hadoop-2.0.0-cdh4.6.0/src/hadoop-mapreduce1-project/src/contrib/eclipse-plugin目录下
ant jar
按提示有未定义的,再引入jar库
9)错误提示:case需要常量,修改如下文件
./src/hadoop-mapreduce1-project/src/contrib/eclipse-plugin/src/java/org/apache/hadoop/eclipse/server/HadoopJob.java
static JobState ofInt(int state) {
10)编译通过后,在
hadoop-2.0.0-cdh4.6.0/src/hadoop-mapreduce1-project/build/contrib/eclipse-plugin
包含 hadoop-eclipse-plugin-2.0.0.jar 拷贝到eclipse的目录下重启elcipse
如果是yarn 框架的还是用新的mapre2的吧~~~~~
0 0
- hadoop cdh4 eclipse plugin
- 编译cdh4-hadoop的eclipse插件
- hadoop eclipse plugin 插件
- hadoop compile eclipse-plugin
- 安装Hadoop Eclipse plugin
- 编译 Hadoop Eclipse Plugin
- hadoop-2.0.0-mr1-cdh4.2.2 eclipse插件安装
- hadoop-eclipse-plugin 编译 打包
- Hadoop-eclipse-plugin插件安装
- hadoop eclipse plugin jar 下载
- hadoop eclipse plugin 自编译
- 编译打包eclipse hadoop plugin
- hadoop-eclipse-plugin安装配置
- Hadoop-eclipse-plugin插件安装
- hadoop-1.2.1 Eclipse plugin
- Hadoop源码打包hadoop-eclipse-plugin插件
- hadoop cdh4 下载地址
- hadoop cdh4 文件结构
- Linux主机名Hostname详解
- linux top (转载)
- hadoop-yarn架构的内存相关设置
- hadoop的datanode多磁盘空间不统一…
- linux将程序放在后台运行
- hadoop cdh4 eclipse plugin
- 3D游戏中“刀光剑影”特效的实现算法
- 设计模式--对职责链模式的思考
- 蓝牙技术发展
- Redis 常用命令
- unix命令自我总结
- Android SDK Manager不能更新的解决方案(已验证于2014.6.25)
- 进程与线程的区别
- 字符串中重复字符的处理