在Eclipse中导入hadoop
来源:互联网 发布:yum install chromium 编辑:程序博客网 时间:2024/05/29 14:25
转自:http://blog.csdn.net/amaowolf/article/details/8126832
0. 准备(1)需要有gcc、autoconf、automake来编译安装google的protocol buffer
(2)http://protobuf.googlecode.com/files/protobuf-2.4.1.tar.gz
./configure --prefix=/usr/local
make
make check
sudo make install
完成后,检验
$ protoc
Missing input file.
(3) JDK、ANT、Maven(MVN)
1. 在Eclipse中增加SVN插件
在help->install new software
添加http://subclipse.tigris.org/update/
在window/Open Perspective中就会右SVN的视图
2. 导出代码(该trunk下面右多个project)
svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/ hadoop-trunk3. mvn: build the code to get it ready for importing into Eclipse.
cd haoop-trunk$ mvn install -DskipTests
$ mvn eclipse:eclipse -DdownloadSources=true -DdownloadJavadocs=true
Note: This may take a while the first time,
as all libraries are fetched from the internet, and the whole build is performed
error:
Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-proto)
on project hadoop-common: Command execution failed. Cannot run program "protoc"
issue: install google's protocol buffer
4. In Eclipse
After the above, do the following to finally have projects in Eclipse ready and waiting for you to go on that scratch-itching development spree:
For Common
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-common-project directory as the root directory
Select the hadoop-annotations, hadoop-auth, hadoop-auth-examples and hadoop-common projects
Click "Finish"
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-assemblies directory as the root directory
Select the hadoop-assemblies project
Click "Finish"
To get the projects to build cleanly:
* Add target/generated-test-sources/java as a source directory for hadoop-common
* You may have to add then remove the JRE System Library to avoid errors due to access restrictions
For HDFS
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-hdfs-project directory as the root directory
Select the hadoop-hdfs project
Click "Finish"
For MapReduce
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-mapreduce-project directory as the root directory
Select the hadoop-mapreduce-project project
Click "Finish"
Note: in the case of MapReduce the testjar package is broken. This is expected since it is a part of a testcase that checks for incorrect packaging. This is not to be worried about.
To run tests from Eclipse you need to additionally do the following:
Under project Properties, select Java Build Path, and the Libraries tab
Click "Add External Class Folder" and select the build directory of the current project
- 在Eclipse中导入hadoop
- 在Eclipse中导入hadoop
- 在Eclipse中导入hadoop
- Hadoop导入Eclipse中
- eclipse中导入hadoop源码
- Hadoop源码导入eclipse中
- 在2.x版本中,将hadoop源代码导入到eclipse中:
- 在Eclipse中导入JavaDoc
- 在eclipse4.5中导入hadoop源码
- hadoop----eclipse导入hadoop源码
- hadoop----eclipse导入hadoop源码
- hadoop----eclipse导入hadoop源码
- Hadoop源码导入Eclipse
- Eclipse 导入 Hadoop 源码
- Hadoop源码导入Eclipse
- hadoop源码导入eclipse
- Eclipse导入Hadoop源码
- eclipse 导入hadoop源码
- hdu1385Minimum Transport Cost 最短路
- 工作总结——Lucene使用
- 浅谈国际化
- SVM入门经典讲解(相当好)
- Spring3+MyBatis3整合无法输出SQL语句问题的解决
- 在Eclipse中导入hadoop
- 【wpf】利用wpf写的一个登录界面--美感为零的程序员伤不起
- HDU4334(多重循环)
- 批处理常用命令总结
- 光流OpticalFlow介绍与OpenCV实现
- 强行删除oracle新建的用户
- 【Android UI设计与开发】第10期:顶部标题栏(一)ActionBar详细概述和简单示例
- 简易消息提示框Toast和通知的使用
- yoda's Crypter 1.2源码分析