hadoop 启动的时候datanode报错 Problem connecting to server

2014-05-11 10:43:33,970 WARNorg.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server:master/202.106.199.36:9000

 

2014-05-11 10:43:55,009 INFOorg.apache.hadoop.ipc.Client: Retrying connect to server:master/202.106.199.36:9000. Already tried 0 time(s); retry policy isRetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)

2014-05-11 10:43:56,012 INFOorg.apache.hadoop.ipc.Client: Retrying connect to server:master/202.106.199.36:9000. Already tried 1 time(s); retry policy isRetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)

 

 其中datanode与namenode的Ip都可以ping通。

其实根本原因还是无法连接到202.106.199.36:9000 相应ip的相应端口。

 

查看一下namenode的端口监听情况：

 

[hdp@hadoop1 sbin]$ netstat -an | grep 9000

tcp        0      0 127.0.0.1:9000              0.0.0.0:*                   LISTEN     

tcp        0     0 127.0.0.1:37072            127.0.0.1:9000             TIME_WAIT   

 

其实问题就再这里，hadoop启动的时候只监听了127.0.0.1一个端口，而不是192.168.10.22:9000。这种情况下，也就只有本机才能联通127.0.0.1:9000了。

 

看来是ip解析的问题，看一下namenode的hosts文件（只列出了重要部分）：

 

127.0.0.1              localhost

127.0.0.1     master

202.106.199.36 master

202.106.199.37node1

202.106.199.38node2

 

其实主要问题就在标红的部分去掉即可。然后停止hdfs(stop-dfs.sh),在打开hdfs(start-dfs.sh) 

检查一下端口监听情况：

[root@hadoop1 network-scripts]# netstat -an | grep 9000

tcp        0      0 202.106.199.36:9000     0.0.0.0:*               LISTEN  

tcp        0      0 202.106.199.36:33862    202.106.199.36:9000     TIME_WAIT  
tcp        0      0 202.106.199.36:9000     202.106.199.37:59520    ESTABLISHED
tcp        0      0 202.106.199.36:9000     202.106.199.38:47317    ESTABLISHED
tcp        0      0 202.106.199.36:9000     202.106.199.38:47298    ESTABLISHED
tcp        0      0 202.106.199.36:9000     202.106.199.38:47300    ESTABLISHED
tcp        0      0 202.106.199.36:9000     202.106.199.38:47299    ESTABLISHED
tcp        0      0 202.106.199.36:33869    202.106.199.36:9000     TIME_WAIT  
tcp        0    729 202.106.199.36:9000     202.106.199.38:47326    ESTABLISHED
tcp        0      0 202.106.199.36:9000     202.106.199.38:47277    ESTABLISHED
tcp        0      0 202.106.199.36:9000     202.106.199.38:47301    ESTABLISHED
tcp        0      0 202.106.199.36:9000     202.106.199.38:47297    ESTABLISHED

 

修改后datanode就可以正常连接namenode了。