hadoop分布式集群部署

1.hosts文件检查
所有节点的hosts文件都要配置静态ip与hostname之间的对应关系

[root@cs0 ~]# vi /etc/hosts/*i进入编辑模式:wq! 强制保存文件，并退出vi:q! 不保存文件，强制退出vi:e! 放弃所有修改，从上次保存文件开始再编辑*/43.254.2.134  ecs-node143.254.2.105  ecs-node247.93.251.126 ecs-node3

2.配置SSH免密码通信

hadoop@cs0 ~]$ mkdir .ssh  // 注意：此处的需要使用chmod 700 .ssh 将权限改为700[hadoop@cs0 ~]$ ssh-keygen -t rsa     //执行命令一路回车，生成秘钥[hadoop@cs0 ~]$cd .ssh [hadoop@cs0 .ssh]$ ls authorized_keys  id_rsa  id_rsa.pub  known_hosts[hadoop@cs0 .ssh]$ cat id_rsa.pub >> authorized_keys               //将公钥保存到authorized_keys认证文件中               //注意：authorized_keys 的权限为600 

3.集群所有节点都要行上面的操作。
进行免密登陆

ssh  -o StrictHostKeyChecking=no  43.254.2.134ssh ecs-node1

将所有节点中的共钥id_ras.pub拷贝到ecs-node1中的authorized_keys文件中。

[root@ecs-node2 .ssh]# cat ~/.ssh/id_rsa.pub | ssh root@ecs-node1 'cat >> ~/.ssh/authorized_keys'[root@ecs-node3 .ssh]# cat ~/.ssh/id_rsa.pub | ssh root@ecs-node1 'cat >> ~/.ssh/authorized_keys'

所有节点都需要执行这条命令

然后将cs0中的authorized_keys文件分发到所有节点上面。

[root@ecs-node1 .ssh]# scp -r authorized_keys root@ecs-node2:~/.ssh/[root@ecs-node1 .ssh]# scp -r authorized_keys root@ecs-node3:~/.ssh/大家通过ssh 相互访问，如果都能无密码访问，代表ssh配置成功。

[root@ecs-node1 .ssh]# ssh ecs-node2    Last login: Tue May 30 14:26:26 2017 from 43.254.2.134    Welcome to Alibaba Cloud Elastic Compute Service ![root@ecs-node2 .ssh]# ssh ecs-node3  ######################################################################  #                              Notice                                #  #                                                                    #  #  1. Please DO NOT upgrade the kernel, as the kernel upgrade would  #  #   damage the original operating system.                            #  #                                                                    #  #  2. Please create unique passwords that use a combination of words,#  #   numbers, symbols, and both upper-case and lower-case letters.    #  #   Avoid using simple adjacent keyboard combinations such as        #   #   "Qwert!234","Qaz2wsx",etc.                                       #  #                                                                    #  #  3. Unless necessary, please DO NOT open or use high-risk ports,   #  #   such as Telnet-23, FTP-20/21, NTP-123(UDP), RDP-3389,            #  #   SSH/SFTP-22, Mysql-3306, SQL-1433,etc.                           #  #                                                                    #  #                     Any questions please contact 4000-955-988      #  ######################################################################[root@ecs-node3 .ssh]# ssh ecs-node1