hadoop2.7.4的安装
来源:互联网 发布:mac迅雷总是开机启动 编辑:程序博客网 时间:2024/06/06 09:22
1.下载hadoop2.7.4,地址http://www.apache.org/dyn/closer.cgi/Hadoop/common/hadoop-2.7.4/hadoop-2.7.4.tar.gz
2.设置ssh的免密登录
ssh-keygen -t rsa
cat ~/.ssh/id_rsa.pub~/.ssh/authorized_keys
ssh localhost
3.设置Hadoop的配置文件
a).core-site.xml
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/Users/lxiong/myapp/Project/hadoop/temp/</value>
<description>A base for other temporary directories.</description>
</property>
b).hdfs-site.xml
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>/Users/lxiong/myapp/Project/hadoop/temp/dfs/name</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>/Users/lxiong/myapp/Project/hadoop/temp/dfs/data</value>
</property>
c).mapred-site.xml
<property>
<name>mapred.job.tracker</name>
<value>localhost:9001</value>
</property>
d).yarn-site.xml
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
e).hadoop-env.sh
export JAVA_HOME=/Library/Java/JavaVirtualMachines/1.8.0.jdk/Contents/Home(跟自己的jdk安装的目录有关)
export HADOOP_HOME=/Users/lxiong/myapp/install/hadoop-2.7.1(跟自己的hadoop安装的目录有关)
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib:$HADOOP_COMMON_LIB_NATIVE_DIR"
4.设置系统的环境变量
export HADOOP_HOME=/Users/lxiong/myapp/install/hadoop-2.7.4(跟自己的hadoop放置的目录有关)
export PATH=$PATH:$HADOOP/bin
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib:$HADOOP_COMMON_LIB_NATIVE_DIR"
配置完后,source一下该文件
5.在本地建立三个文件夹
/Users/lxiong/myapp/Project/hadoop/temp/dfs/name
/Users/lxiong/myapp/Project/hadoop/temp/dfs/data
/Users/lxiong/myapp/Project/hadoop/temp
6.格式化文件系统:hdfs namenode -format
7.sbin/start-all.sh
8.访问localhost:50070和localhost:8088测试是否正常
9.查看hdfs文件系统,如:hadoop fs -ls /
- hadoop2.7.4的安装
- Hadoop2.7.4集群的Linux安装步骤
- hadoop2.7.3的安装
- hadoop2的伪分布式安装
- hadoop2.x集群的安装
- hadoop2.7.2的安装过程
- Hadoop2.7.4 MapReduce集群的Linux安装步骤
- hadoop2安装
- hadoop2伪分布式的安装及测试
- hadoop2.4和tez的安装
- 我的hadoop2.4安装过程
- hadoop2.2.0安装的几个配置文件
- ubuntu14.04.1 下hadoop2.6.0 的安装
- Hadoop2.x的安装与配置
- Linux下Hadoop2.6的安装
- hadoop2.X集群上Hbase的安装
- Mac Hadoop2.7.2的安装与配置
- 安装hadoop2.x出现的问题
- 使用HTML语言和CSS开发商业站点_HTML基础
- python中文注释报错解决方法
- Messages BreakPoints in 64dbg(翻译)
- leetcode 4.Median of Two Sorted Arrays
- POJ 1661 Help Jimmy
- hadoop2.7.4的安装
- OPC数据访问方法简介
- Java程序员面试题及解答(一)
- spring笔记6-事物及整合hibernate
- Java递归删除树形结构父节点
- matlab读写pgm文件
- C++中的重写、重载、重定义
- 排序算法之归并排序及利用归并排序求逆序数
- hdu 1224