Hadoop笔记十NameNode启动异常

来源:互联网 发布:ubuntu增加存储空间 编辑:程序博客网 时间:2024/05/13 07:29

异常一:

增加一个slave后namenode无法启动,异常如图:





原因如下:

集群运行时,加入新机器,这时对hdfs-site.xml中的namenode进行了namenode -format操作,导致问题(clusterid expected 和seen 不符,txid expected 和seen 不符)。加入新机器时要额外小心配置。布置一个新集群时如果拷贝这个集群的配置,也一定要将namenode等设置配置好,否则等同于重新 namenode format运行中的集群。


解决:

   关闭集群,

       cd /home/zkpk(自定义)/hadoop-2.5.2/

       sbin/start-all.sh

   修改配置文件

       vim    hdfs-site.xml

       将value加1

   格式化namenode

       hdfs  namenode  -format


详情如:http://blog.csdn.net/fiveyears/article/details/20934353



异常二:

一:异常结果

-03-02 17:59:59,467 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2016-03-02 17:59:59,478 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for active state
2016-03-02 17:59:59,478 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 2
2016-03-02 17:59:59,480 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 2 Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 20
2016-03-02 17:59:59,481 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /tmp/hadoop/dir/dfs/name/current/edits_inprogress_0000000000000000002 -> /tmp/hadoop/dir/dfs/name/current/edits_0000000000000000002-0000000000000000003
2016-03-02 17:59:59,488 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for active state
2016-03-02 17:59:59,488 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for standby state
2016-03-02 17:59:59,493 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
2016-03-02 17:59:59,494 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...
2016-03-02 17:59:59,494 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.
2016-03-02 17:59:59,494 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.
2016-03-02 17:59:59,495 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
java.net.BindException: Problem binding to [master:9000] java.net.BindException: Cannot assign requested address; For more details see:  http://wiki.apache.org/hadoop/BindException
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
    at org.apache.hadoop.ipc.Server.bind(Server.java:419)
    at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
    at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
    at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
    at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
    at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
    at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.<init>(NameNodeRpcServer.java:311)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:614)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:587)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:751)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:735)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1407)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1473)
2016-03-02 17:59:59,499 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
2016-03-02 17:59:59,500 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at master/192.168.80.9
************************************************************/

二:异常分析及其解决方案:

上述异常由于主节点与从节点所在wired network网络空间不同,导致集群在启动时不能开启Namenode进程。

所以说必须保证主从节点网络空间一致,具体操作:分别左击虚拟机右上角计算机图标将其调至相同网络空间。

1 0
原创粉丝点击