Hadoop Configurations (Properties)

来源:互联网 发布:手机淘宝怎样退出登录 编辑:程序博客网 时间:2024/05/22 06:12


Hadoop运行的三种模式:

Standalone (or local) mode

Pseudodistributed mode

Fully distributed mode


模式的配置文件在 hadoop-2.8.1/etc/hadoop 目录:

core-site.xml for common properties

hdfs-site.xml for HDFS properties

mapred-site.xml for MapReduce properties

yarn-site.xml for YARN properties


这些配置文件负责的全部属性的默认设置文件,在 hadoop-2.8.1/share/doc/hadoop 目录:

hadoop-project-dist/hadoop-common/core-default.xml

hadoop-project-dist/hadoop-hdfs/hdfs-default.xml

hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml

hadoop-yarn/hadoop-yarn-common/yarn-default.xml


要让Hadoop运行在某个特定的模式,需要两件事情:

1. set the appropriate properties

2. start the Hadoop daemons


下面图片,是配置成每种模式时的 最小属性集 (the minimal set of properties):



跟多的配置信息: