Install Hadoop on local machine
来源:互联网 发布:java中合法关键字 编辑:程序博客网 时间:2024/05/16 13:05
- install JDK
- Install hadoop
- Run Project on Hadoop
install JDK
需要提前安装好jdk和ant。
jdk是对java程序进行编译的工具(java development kid)
jre:java runtime environment是提供java虚拟机的运行环境。
ant:项目管理工具,用于Hadoop的项目管理。
Hadoop Mapreducer就是运行在Java虚拟机里面的(JVM)
所以我们需要安装好JDK和ANT。
安装JDK的话,需要注意的是安装在Ubuntu16.04上的时候,jdk1.7是比较老的了,需要自己添加仓库。
sudo add-apt-repository ppa:openjdk-r/ppa sudo apt-get update sudo apt-get install openjdk-7-jdk
参考【1】【2】【3】【4】。
安装ANT:
sudo apt-get install ant
检测刚才上面的安装是否成功:
java -versionjavac -versionant -version
如果你的mac os x安装了有多个版本的问题,看【5】
Install hadoop
download hadoop:
$ wget https://archive.apache.org/dist/hadoop/core/hadoop-2.4.0/hadoop-2.4.0.tar.gz
unzip:
$ tar xzvf hadoop-2.4.0.tar.gz
export executable path to system:
$ export PATH=$PATH:$HOME/hadoop-2.4.0/bin
then test:
$ hadoop
If command line interface is shown “Error: JAVA_HOME is not set and could not be found.
“, just do the following steps.
If you’re getting error, it may be possible that the Hadoop command requires JAVA_HOME environment variable to be set. You may need to do the following (update the JAVA_HOME directory according to your environment setup):
# Set JAVA_HOME environment variable$ export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64$ export PATH=$JAVA_HOME/bin:$PATH
The result is like:
Run Project on Hadoop
make file folder: ~/645/fastcode/
Download file from:
wget https://cmu.box.com/shared/static/2fwqjutnf8u299sbotkgqamoc7iweawx.gz -O Proj3.tar.gz
…….
参考链接:
【1】安装openjdk-7-jdk:http://blog.csdn.net/csm_qz/article/details/51510667
【2】安装openjdk-7-jdk:http://www.cnblogs.com/bluestorm/p/5677625.html
【3】安装openjdk-7-jdk:http://blog.csdn.net/donglynn/article/details/51382172
【4】选择正确的Java版本:http://blog.csdn.net/u010856630/article/details/51660012
【5】max os x的多个版本的问题:https://andrew-jones.com/blog/managing-multiple-versions-of-java-on-os-x/
- Install Hadoop on local machine
- Install sharelatex on virtual machine
- Quick Install Hadoop on Windows
- install apache hadoop on ubuntu
- the vfpoledb provider is not registered on the local machine
- Error starting target ‘chcp: ‘ on machine ‘Local CPU 1′
- How to test Apache CloudStack 4.2 on your local machine
- How to install local yum server on linux
- install software from local cd/dvd on opensuse
- Install Hadoop on Ubuntu with two computers
- lesson 2 hbase install on hadoop
- How to Install Hadoop on Ubuntu 13.10
- How to Install Hadoop on Ubuntu 13.10
- CDH(hadoop) install on ubuntu 14.04server
- You must install 'makeinfo' on your build machine
- You must install 'makeinfo' on your build machine
- You must install 'msgfmt' on your build machine
- You must install 'makeinfo' on your build machine
- 网络寻路(dfs或者枚举)
- linux自旋锁——读写锁
- nginx.conf配置示例讲解
- java一些常用代码的分享
- unity3D EasyAR 识别模型抖动解决方案
- Install Hadoop on local machine
- 设计模式(三)装饰者模式之java.io
- 爬取豆瓣电影数据
- 继承
- 在ASP.NET中使用SQL Server作为数据库,DB First方式使用EF(EntityFramework)进行开发和部署时的connectionString
- javascript DOM节点、元素
- MySQL 多表关联更新及删除
- 4.6第七周
- Ubuntu Numix 图标安装