hadoop安装(一)

来源:互联网 发布:研究生做软件测试待遇 编辑:程序博客网 时间:2024/06/10 17:34
hadoop安装(一) 环境准备
1、准备五台机器
2、每台机器都安装CENTOS6.7 64位,并创建普通用户hadoop
3、修改主机名
编辑每台机器/etc/hosts文件,配置反向解析
#cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.137.11  hadoop-namenode
192.168.137.12  hadoop-namenode-backup
192.168.137.13  hadoop-datanode1
192.168.137.14  hadoop-datanode2
192.168.137.15  hadoop-datanode3
4、配置网络
在第一台机器中配置
cat /etc/sysconfig/network-scripts/ifcfg-eth0 
DEVICE=0
TYPE=Ethernet
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=static
IPADDR=192.168.137.11
NETWORK=255.255.255.0
GATEWAY=192.168.137.1
依次在其它四机器中配置相应的IP
5、关闭iptables
在每台机器上运行
service iptables stop
chkconfig iptables off
6、关闭selinux
在每台机器上编辑
/etc/selinux/config
7、安装JDK
在hadoop-namenode机器上安装JDK,本次操作下载的是jdk-7u79-linux-x64.tar.gz,一定要下载JDK,可以进行编译,JRE只有运行环境,可以用户hadoop身份进行操作,安


装路径为/home/hadoop/
8、编辑/etc/profile
在每台机器中的/etc/profile文件末尾处加上
############################
export  JAVA_HOME=/home/hadoop/jdk1.7.0_79
export  JRE_HOME=${JAVA_HOME}/jre
export  CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
export  PATH=$JAVA_HOME/bin:$PATH
export  HADOOP_HOME=/home/hadoop/hadoop-2.7.1
export  PATH=$HADOOP_HOME/bin:$PATH
export  PATH=$HADOOP_HOME/sbin:$PATH
编辑完成,运行命令
#env|grep JAVA 
#source /etc/profile
9、检查
#jps
显示当前所有java进程pid的命令
10、可视情删除/etc/udev/rules.d/70-persistent-net.rules文件,重启后可自动生成,主要是为防止出现意外的网络故障 
11、配置yum源,编辑/etc/yum.repos.d/CentOS-Base.repo

[base]
name=CentOS-$releasever - Base - 163.com
baseurl=http://mirrors.163.com/centos/$releasever/os/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=os
gpgcheck=1
gpgkey=http://mirror.centos.org/centos/RPM-GPG-KEY-CentOS-6


#released updates 
[updates]
name=CentOS-$releasever - Updates - 163.com
baseurl=http://mirrors.163.com/centos/$releasever/updates/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=updates
gpgcheck=1
gpgkey=http://mirror.centos.org/centos/RPM-GPG-KEY-CentOS-6


#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras - 163.com
baseurl=http://mirrors.163.com/centos/$releasever/extras/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=extras
gpgcheck=1
gpgkey=http://mirror.centos.org/centos/RPM-GPG-KEY-CentOS-6


#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-$releasever - Plus - 163.com
baseurl=http://mirrors.163.com/centos/$releasever/centosplus/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=centosplus
gpgcheck=1
enabled=0
gpgkey=http://mirror.centos.org/centos/RPM-GPG-KEY-CentOS-6


#contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib - 163.com
baseurl=http://mirrors.163.com/centos/$releasever/contrib/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=contrib
gpgcheck=1
enabled=0
gpgkey=http://mirror.centos.org/centos/RPM-GPG-KEY-CentOS-6
更改yum源,也可以参阅http://mirrors.163.com/.help/centos.html
运行 yum makecache 产生本地缓存
12、设置DNS,编辑/etc/resolv.conf文件
search 210.22.70.225
nameserver 140.207.198.6
0 0
原创粉丝点击