hadoop群集get文件的时候出现报错

来源：互联网发布：阿里云服务器入门编辑：程序博客网时间：2024/05/16 19:15

今天hadoop群集get文件的时候出现报错，如下：
$hdfs dfs -get /test/part-r-00000.gz ./

15/09/15 09:20:33 INFO hdfs.DFSClient: Access token was invalid when connecting to /192.168.2.42:50010 : org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51440, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
15/09/15 09:20:33 WARN hdfs.DFSClient: Failed to connect to /192.168.2.42:50010 for block, add to deadNodes and continue. org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
    at org.apache.hadoop.hdfs.RemoteBlockReader2.checkSuccess(RemoteBlockReader2.java:425)
    at org.apache.hadoop.hdfs.RemoteBlockReader2.newBlockReader(RemoteBlockReader2.java:397)
    at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReader(BlockReaderFactory.java:786)
    at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:665)
    at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:325)

获取不到Block文件，后来发现有人大量的使用put命令进行文件的上传，导致hdfs拥堵，所以下载不了文件，kill到put进程，就恢复正常了。

0 0