CentOs7搭建hadoop集群(伪分布式)下

来源:互联网 发布:淘宝商品推广平台 编辑:程序博客网 时间:2024/06/05 23:32
    在yarn-site.xml新增    `    <property>                          <name>yarn.nodemanager.vmem-check-enabled</name>                <value>false</value>             </property>    `    开启服务:`start-yarn.sh`    查看java进程:jps,出现以下即成功    `11750 ResourceManager    11854 NodeManager`检测:http://169.254.214.10:8088

hdfs shell

mkdir:创建目录:    hadoop fs -mkdir -p /user/hadoop        hadoop fs -mkdir input  mv:移动rm:删除    hadoop fs -rm -r output1(移除)put:上传    hadoop fs -put README.txt .    hadoop fs -put *.xml ./inputget:下载    hadoop fs -get output1/* cat text:看    cat part-r-00000                                 :查看本地    hadoop fs -text /user/hadoop/output1/part-r-00000   :查看hadoop集群上    hadoop jar hadoop-mapreduce-examples-2.9.0.jar wordcount input output1 统计单词出现的次数并打包发送到output1目录里