Hadoop2.7.1 配置三个.xml文件的创建地址

来源:互联网 发布:怎么在淘宝上买小说 编辑:程序博客网 时间:2024/05/23 13:52

我最初是hadoop1.0.1,已经搭建好了的,现在想把它换成2.7.1,结果起来之后,只有JPS服务起来了,其他几个没有服务没有起来,我见网上说的是在写权限不够16/03/01 21:21:00 WARN namenode.NameNode: Encountered exception during format:
java.io.IOException: Cannot create directory /home/hadoop/leen/hadoop/tmp/dfs/name/current
这个文件的时候权限不够,但是我现在用的是root权限啊!求大神指点,相关的配置文件是按照这个链接博文写的,稍微结合自己的做了修改,希望大家能帮忙指点一下

STARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r 15ecc87ccf4a0228f35af08fc56de536e6ce657a; compiled by 'jenkins' on 2015-06-29T06:04ZSTARTUP_MSG:   java = 1.7.0_79************************************************************/16/03/01 21:20:54 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]16/03/01 21:20:54 INFO namenode.NameNode: createNameNode [-format]Formatting using clusterid: CID-2e0fcf64-17b7-46da-88ce-4e4c0abc902916/03/01 21:20:59 INFO namenode.FSNamesystem: No KeyProvider found.16/03/01 21:20:59 INFO namenode.FSNamesystem: fsLock is fair:true16/03/01 21:20:59 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=100016/03/01 21:20:59 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true16/03/01 21:20:59 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.00016/03/01 21:20:59 INFO blockmanagement.BlockManager: The block deletion will start around 2016 Mar 01 21:20:5916/03/01 21:20:59 INFO util.GSet: Computing capacity for map BlocksMap16/03/01 21:20:59 INFO util.GSet: VM type       = 64-bit16/03/01 21:20:59 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB16/03/01 21:20:59 INFO util.GSet: capacity      = 2^21 = 2097152 entries16/03/01 21:20:59 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false16/03/01 21:20:59 INFO blockmanagement.BlockManager: defaultReplication         = 116/03/01 21:20:59 INFO blockmanagement.BlockManager: maxReplication             = 51216/03/01 21:20:59 INFO blockmanagement.BlockManager: minReplication             = 116/03/01 21:20:59 INFO blockmanagement.BlockManager: maxReplicationStreams      = 216/03/01 21:20:59 INFO blockmanagement.BlockManager: shouldCheckForEnoughRacks  = false16/03/01 21:20:59 INFO blockmanagement.BlockManager: replicationRecheckInterval = 300016/03/01 21:20:59 INFO blockmanagement.BlockManager: encryptDataTransfer        = false16/03/01 21:20:59 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 100016/03/01 21:20:59 INFO namenode.FSNamesystem: fsOwner             = leen (auth:SIMPLE)16/03/01 21:20:59 INFO namenode.FSNamesystem: supergroup          = supergroup16/03/01 21:20:59 INFO namenode.FSNamesystem: isPermissionEnabled = true16/03/01 21:20:59 INFO namenode.FSNamesystem: HA Enabled: false16/03/01 21:20:59 INFO namenode.FSNamesystem: Append Enabled: true16/03/01 21:21:00 INFO util.GSet: Computing capacity for map INodeMap16/03/01 21:21:00 INFO util.GSet: VM type       = 64-bit16/03/01 21:21:00 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB16/03/01 21:21:00 INFO util.GSet: capacity      = 2^20 = 1048576 entries16/03/01 21:21:00 INFO namenode.FSDirectory: ACLs enabled? false16/03/01 21:21:00 INFO namenode.FSDirectory: XAttrs enabled? true16/03/01 21:21:00 INFO namenode.FSDirectory: Maximum size of an xattr: 1638416/03/01 21:21:00 INFO namenode.NameNode: Caching file names occuring more than 10 times16/03/01 21:21:00 INFO util.GSet: Computing capacity for map cachedBlocks16/03/01 21:21:00 INFO util.GSet: VM type       = 64-bit16/03/01 21:21:00 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB16/03/01 21:21:00 INFO util.GSet: capacity      = 2^18 = 262144 entries16/03/01 21:21:00 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.999000012874603316/03/01 21:21:00 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 016/03/01 21:21:00 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension     = 3000016/03/01 21:21:00 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 1016/03/01 21:21:00 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 1016/03/01 21:21:00 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,2516/03/01 21:21:00 INFO namenode.FSNamesystem: Retry cache on namenode is enabled16/03/01 21:21:00 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis16/03/01 21:21:00 INFO util.GSet: Computing capacity for map NameNodeRetryCache16/03/01 21:21:00 INFO util.GSet: VM type       = 64-bit16/03/01 21:21:00 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB16/03/01 21:21:00 INFO util.GSet: capacity      = 2^15 = 32768 entries16/03/01 21:21:00 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1510641234-127.0.1.1-145683846019516/03/01 21:21:00 WARN namenode.NameNode: Encountered exception during format:java.io.IOException: Cannot create directory /home/hadoop/leen/hadoop/tmp/dfs/name/current    at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:337)    at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:548)    at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:569)    at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:161)    at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:991)    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1429)    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)16/03/01 21:21:00 ERROR namenode.NameNode: Failed to start namenode.java.io.IOException: Cannot create directory /home/hadoop/leen/hadoop/tmp/dfs/name/current    at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:337)    at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:548)    at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:569)    at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:161)    at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:991)    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1429)    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)16/03/01 21:21:00 INFO util.ExitUtil: Exiting with status 116/03/01 21:21:00 INFO namenode.NameNode: SHUTDOWN_MSG:/************************************************************SHUTDOWN_MSG: Shutting down NameNode at ubuntu/127.0.1.1************************************************************/leen@ubuntu:/usr/share/hadoop-2.7.1$ sbin/start-dfs.shStarting namenodes on [localhost]localhost: starting namenode, logging to /usr/share/hadoop-2.7.1/logs/hadoop-leen-namenode-ubuntu.outlocalhost: starting datanode, logging to /usr/share/hadoop-2.7.1/logs/hadoop-leen-datanode-ubuntu.outStarting secondary namenodes [0.0.0.0]0.0.0.0: starting secondarynamenode, logging to /usr/share/hadoop-2.7.1/logs/hadoop-leen-secondarynamenode-ubuntu.outleen@ubuntu:/usr/share/hadoop-2.7.1$ jps9155 Jps

我的配置是按着网上的来的,

http://zhidao.baidu.com/link?url=a5o-u1MuyMW6HoCTjH5YoFcQbmFNZIHwl-VBFuUZELx3IeSkLbZML-VguNmQMgF_zuQjy4mPFLpBlBAJukkL-HGDyVkD9JqBM0S_Ml7T9Nm

具体如下:

1.conf/core-site.xml:<configuration><property>  <name>hadoop.tmp.dir</name>  <value>/home/hadoop/hadooptmp</value>  <description>A base for other temporary directories.</description></property><property>  <name>fs.default.name</name>  <value>hdfs://master:9000</value></property></configuration>2.conf/hadoop-env.sh:export JAVA_HOME=/home/hadoop/jdk1.x.x_xx3. conf/hdfs-site.xml:<configuration><property>  <name>dfs.replication</name>  <value>2</value></property><property>     <name>dfs.data.dir</name>     <value>/home/hadoop/hadoopfs/data</value> </property><property>  <name>dfs.http.address</name>  <value>master:50070</value></property><property>  <name>dfs.back.http.address</name>  <value>node1:50070</value></property><property>  <name>dfs.name.dir</name>  <value>/home/hadoop/hadoopfs/name</value></property><property>  <name>fs.checkpoint.dir</name>  <value>/home/hadoop/hadoopcheckpoint</value></property><property><name>dfs.permissions</name><value>false</value></property></configuration>4.conf/mapred-site.xml:<configuration><property>  <name>mapred.job.tracker</name>  <value>master:9001</value></property><property>  <name>mapred.tasktracker.map.tasks.maximum</name>  <value>4</value></property><property>  <name>mapred.tasktracker.reduce.tasks.maximum</name>  <value>4</value></property><property>  <name>mapred.child.java.opts</name>  <value>-Xmx1000m</value></property></configuration>


0 0
原创粉丝点击
热门问题 老师的惩罚 人脸识别 我在镇武司摸鱼那些年 重生之率土为王 我在大康的咸鱼生活 盘龙之生命进化 天生仙种 凡人之先天五行 春回大明朝 姑娘不必设防,我是瞎子 婚姻质量差不幸福该怎么办 吸毒犯戒毒所不收怎么办 信用卡到期人进拘留所怎么办? 人在拘留所信用卡逾期怎么办 探视权不让接走怎么办 医保过了缴费期怎么办 充电宝充手机慢怎么办 执行局执行不到钱怎么办 小孩挖耳朵疼了怎么办 挖耳朵挖破了怎么办 挖耳朵皮挖破了耳鸣怎么办 北京自考证丢啦怎么办 不服检察院的答复函该怎么办 检察院控申答复函不复怎么办 在看守所里疯了怎么办 第一次吸毒拘留五天第二次会怎么办 被派出所拘留15天怎么办 老公从拘留所出来聪明老婆怎么办 中信信用卡忘记还款了怎么办 监狱的犯人病了怎么办 判缓期间在行政拘留怎么办 法院拘留15天工作怎么办 高血压签定了无期限合同怎么办 法院司法拘留找不到人怎么办 c1骑摩托车要拘留怎么办 欠钱的找不到人怎么办 治安拘留人跑了怎么办 行政拘留拘留所不收应该怎么办 在看守所被打了怎么办 取保候审超过12个月怎么办 拘留20天还没有判刑怎么办 被打了没有证据怎么办 拘留37天后没有放人怎么办 强制执行执行的财产不够怎么办 收到公安局拘留通知家属应该怎么办 对方不出谅解书怎么办 寻衅滋事没抓的 怎么办 公务员政审父母拘留过怎么办 我参与了网赌怎么办 亲人出车祸去世家属怎么办 车牌换了原保险怎么办