Install Hadoop on Ubuntu with two computers
来源:互联网 发布:origin数据分析软件 编辑:程序博客网 时间:2024/05/16 17:29
This post is about the installation of Hadoop on Ubuntu with two computers. The system environment is Ubuntu 12.04, JDK 6, Hadoop 1.0.3. The information of two computers detail as follow:
hostnameIP addressRolemaster192.168.0.10Namenode, Jobtracker, SecondaryNameNodeslave01192.168.0.11Datanode, TasktrackerSupposing that the hadoop is installed, detail information : http://blog.csdn.net/hero_hegang/article/details/8910438.
Copying the virtual machine with hadoop to other physical machine. You had better configure the static IP address.
Step 1: modify the hosts mapping
$ sudo vi /etc/hosts
#type and add the contents as follows:
192.168.0.10 master192.168.0.11 slave01
Step 2: modify the hostname
$ sudo vi /etc/hostname
#type and add the contents respectively as follows:
# the hostname of 192.168.0.10 is master.
# the hostname of 192.168.0.11 is slave01.
Step 3: test the ssh in master shell
$ ssh slave01
#If you don't enter the password, configure successfully.
Step 4: modify the hadoop configure file in master and slave with same confiurations
# modify core-site.xml, mapred-site.xml,masters, slaves as follows:
# modify the property fs.default.name tohdfs://master:9000 in core-site.xml.
# modify the property mapred.job.tracker to master:9001 in core-site.xml.
# modify the content of masters file to master.
# modify the content of slaves file to slave01.
Step 5: delete the contents of directory of dfs.data.dir in hdfs-site.xml in master and slave machines
$sudo rm -r /home/hadoop/data1/*$sudo rm -r /home/hadoop/data2/*
Step 6: close the firewall in master and slave machines
$ sudo ufw disable
Step 7: reformat the namenode in master
$ bin/hadoop namenode -format
Step 8: see the process in masters and slave machines
$ jps$ ssh slave01$ jps
Step 9: see the report of hadoop
$ bin/hadoop dfsadmin -report
- Install Hadoop on Ubuntu with two computers
- install apache hadoop on ubuntu
- Install hunspell with python on Ubuntu
- install opencv with ffmpeg on ubuntu
- Install Java on Ubuntu with Apt-Get
- How to Install Hadoop on Ubuntu 13.10
- How to Install Hadoop on Ubuntu 13.10
- CDH(hadoop) install on ubuntu 14.04server
- install ffserver for streaming with libx264 and mp3lame on ubuntu
- Install PIL with Jpeg support on Ubuntu Oneiric 64bit
- How To Install Wordpress with nginx on Ubuntu 12.04
- Install PIL with Jpeg support on Ubuntu Oneiric 64bit
- How To Install Java on Ubuntu with Apt-Get
- How To Install Java on Ubuntu with Apt-Get
- How To Install Java on Ubuntu with Apt-Get
- How To Install Java on Ubuntu with Apt-Get
- How To Install Java with Apt-Get on Ubuntu 16.04
- How To Install WordPress with LAMP on Ubuntu 16.04
- 通过xpath查找指定的节点
- 因为是第一层抽取层的DSO,所以一般不需要出报表,将激活后生成主数据标识去除打勾。正常激活。
- Core Animation之基础介绍
- 关于CharSequence,字符串等相等问题
- iar icf
- Install Hadoop on Ubuntu with two computers
- mysql数据类型2
- linux grep命令详解
- Core Animation之简单使用CALayer
- hadoop无法启动常见问题
- 【经验交流】优化Win7让玩网游不卡
- Core Animation之多种动画效果
- UIImageView截取部分图片并显示(我的吃货876项目中用的就这个且成功了)
- 【iOS 安全相关】