Hadoop安装

来源：互联网发布：网络违法犯罪举报编辑：程序博客网时间：2024/06/05 20:48

环境：

Ubuntu 12.04

步骤：

1.创建hadoop用户组

$ sudo addgroup hadoop

2.创建hadoop用户

$ sudo adduser -ingroup hadoop hadoop

Is the information correct? [Y/n] Y

3.为hadoop用户添加权限

$ sudo gedit /etc/sudoers

4.使用hadoop用户登陆（我的hadoop密码为123）

wenjing@ubuntu:~$ su hadoopPassword:

5.安装ssh

安装ssh

hadoop@ubuntu:/home/wenjing$ sudo apt-get install openssh-server

启动ssh服务

hadoop@ubuntu:/home/wenjing$ sudo /etc/init.d/ssh start

查看服务是否启动

hadoop@ubuntu:/home/wenjing$ ps -e|grep ssh 2125 ?        00:00:01 ssh-agent22498 ?        00:00:00 sshd

设置免密码登陆，生成私钥和公钥

hadoop@ubuntu:/home/wenjing$ ssh-keygen -t rsa -P ""Generating public/private rsa key pair.Enter file in which to save the key (/home/hadoop/.ssh/id_rsa): /home/hadoop/.ssh/id_rsa already exists.Overwrite (y/n)? yYour identification has been saved in /home/hadoop/.ssh/id_rsa.Your public key has been saved in /home/hadoop/.ssh/id_rsa.pub.The key fingerprint is:6b:35:1f:f5:60:02:27:ff:34:33:50:55:ae:d6:f7:9f hadoop@ubuntuThe key's randomart image is:+--[ RSA 2048]----+|          o o...+||           = . . ||            o O .||             * O ||        S o . + +||         o o o  o||        o   .   .||       .        o||               E.|+-----------------+

将当前用户登陆到ssh客户端？

hadoop@ubuntu:/home/wenjing$ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

登陆ssh

hadoop@ubuntu:/home/wenjing$ ssh localhostWelcome to Ubuntu 12.04.4 LTS (GNU/Linux 3.11.0-15-generic i686) * Documentation:  https://help.ubuntu.com/New release '14.04.1 LTS' available.Run 'do-release-upgrade' to upgrade to it.Last login: Tue Feb 23 23:35:55 2016 from localhost

退出 exit

hadoop@ubuntu:~$ exitlogoutConnection to localhost closed.

6.安装java jdk
本人离线下载到/opt/jdk1.8.0_73
查看是否安装成功

hadoop@ubuntu:/home/wenjing$ java -versionjava version "1.8.0_73"Java(TM) SE Runtime Environment (build 1.8.0_73-b02)Java HotSpot(TM) Client VM (build 25.73-b02, mixed mode)

7.安装hadoop-1.2.1
下载并解压hadoop到/opt/hadoop-1.2.1

8.配置环境变量

进入hadoop文件夹并打开配置文件

hadoop@ubuntu:/opt/hadoop-1.2.1$ sudo gedit conf/hadoop-env.sh

增加如上代码

9.验证是否安装成功

wenjing@ubuntu:/opt/hadoop-1.2.1$ ./bin/hadoop versionHadoop 1.2.1Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1503152Compiled by mattf on Mon Jul 22 15:23:09 PDT 2013From source with checksum 6923c86528809c4e7e6f493b6b413a9aThis command was run using /opt/hadoop-1.2.1/hadoop-core-1.2.1.jar

1 0