Install Single Node Hadoop(2.7.2) on Mac
来源:互联网 发布:java urlencoder 中文 编辑:程序博客网 时间:2024/05/19 23:11
http://blog.hampisoftware.com/index.php/2016/02/22/install-single-node-hadoop-on-mac/
Install Single Node Hadoop on Mac
Operating System: Mac OSX Yosemite
Hadoop Version 2.7.2
Pre-requisites
We need to enable SSH to localhost without a passphrase.
Go to System Preferences, then check “Remote Login” to ON.
Now in a terminal window, ensure that the following succeeds with no passphrase.
$>ssh localhost
Download Hadoop Distribution
Download the latest hadoop distribution from http://mirrors.ibiblio.org/apache/hadoop/common/hadoop-2.7.2/
Hadoop Configuration Files
Go to the directory where your hadoop distribution is installed.
Then change the following files
hadoop_distro/etc/hadoop/hdfs-site.xml
<
configuration
>
<
property
>
<
name
>dfs.replication</
name
>
<
value
>1</
value
>
</
property
>
</
configuration
>
hadoop_distro/etc/hadoop/core-site.xml
<
configuration
>
<
property
>
<
name
>fs.defaultFS</
name
>
<
value
>hdfs://localhost:9000</
value
>
</
property
>
</
configuration
>
hadoop_distro/etc/hadoop/yarn-site.xml
<
configuration
>
<
property
>
<
name
>yarn.nodemanager.aux-services</
name
>
<
value
>mapreduce_shuffle</
value
>
</
property
>
</
configuration
>
hadoop_distro/etc/hadoop/mapred-site.xml
<
configuration
>
<
property
>
<
name
>mapreduce.framework.name</
name
>
<
value
>yarn</
value
>
</
property
>
</
configuration
>
Format HDFS
$bin/hdfs namenode -format
Start HDFS
$sbin/start-dfs.sh
Start YARN
$sbin/start-yarn.sh
更多相关资料:
https://github.com/100steps/Blogs/issues/10
- Install Single Node Hadoop(2.7.2) on Mac
- [hadoop]How To Install Apache Hadoop Pseudo Distributed Mode on a Single Node
- hadoop2.2 single node install
- CDH3(Hadoop 0.20) Install -- RedHat6/CentOS6 -- Single Node
- Running Hadoop On Ubuntu Linux (Single-Node Cluster)
- Running Hadoop on Ubuntu Linux (Single-Node Cluster)
- Setting up a Single Node Cluster on hadoop-0.23.9
- Installing single node Hadoop 2.2.0 on Ubuntu
- Hadoop single node安装
- Hadoop - single node setup
- hadoop single-node配置手记
- Hadoop 2.2 Single-Node Setup
- lesson 2 hbase install on hadoop
- Install OpenCV 2 on Mac OSX
- Install PIL on mac
- ejabbed install on mac
- Install Valgrind on Mac
- Install Git on Mac
- Android Context---学习笔记
- Android使用EventBus遇到的坑!
- java 接口 实现和继承关系
- Windows上Dbgview打印log信息
- 分组背包-hdu3033
- Install Single Node Hadoop(2.7.2) on Mac
- 【EmbeddedDev】BBB上打开PWM串口并进行操作
- POJ 1182食物链_DisjointSet并查集
- 谈谈MVC模式
- java学习日记_12:面向对象之如何使用类
- [深入浅出Cocoa]详解键值观察(KVO)及其实现机理
- C++可变模板参数中&&和&的使用
- 获得两个GPS点距离(数据库和java)
- iOS 中饼状图的自定义绘制