[解决]java.io.IOException: Cannot obtain block length for LocatedBlock
来源:互联网 发布:matlab 画数组 编辑:程序博客网 时间:2024/05/21 08:05
在hadoop测试集群运行job的过程中发现部分运行失败,有Cannot obtain block length for LocatedBlock,使用hdfs dfs -cat ${文件}的时候也报这个错,看过代码后发现是文件未被正常关闭(flume传到hdfs上的,可能由于Namenode长时间gc或者切换或者重启会留下很多.tmp结尾的文件),为此,使用hadoop命令显示处于打开状态的文件,然后删除这些文件:
hadoop fsck / -openforwrite | egrep -v '^\.+$' | egrep "MISSING|OPENFORWRITE" | grep -o "/[^ ]*" | sed -e "s/:$//" | xargs -i hadoop fs -rmr {};
然后重传这些文件到hdfs
zz:http://blog.csdn.net/odailidong/article/details/51420701
0 0
- [解决]java.io.IOException: Cannot obtain block length for LocatedBlock
- [解决]java.io.IOException: Cannot obtain block length for LocatedBlock
- [解决]java.io.IOException: Cannot obtain block length for LocatedBlock
- [解决]java.io.IOException: Cannot obtain block length for LocatedBlock
- Cannot obtain block length for LocatedBlock故障分析和解决
- Cannot obtain block length for LocatedBlock故障分析与解决
- java.io.IOException: Could not obtain block: blk
- java.io.IOException: Could not obtain block: blk
- java.io.IOException: No FileSystem for scheme: hdfs异常解决
- java.io.IOException: No FileSystem for scheme: hdfs异常解决
- java.io.IOException: Cannot run program "mvn":
- hive java.io.IOException: Cannot initialize Cluster
- Android java.io.IOException: Permission denied 解决
- java.lang.NoClassDefFoundError;java.io.IOException: Cannot initialize Cluster.
- Cannot run program : java.io.IOException: error=2
- 关于java.io.IOException: Cannot run program "unzip":
- maven hadoop2.2.0 java.io.IOException: Cannot initialize Cluster
- hadoop java.io.IOException: Cannot run program "nice"
- 【JavaScript】JavaScript小弹窗及其传值
- MySQL图形化管理工具
- ATP-测试问题记录
- Java Security 总纲
- NDK开发—基础知识实战Demo
- [解决]java.io.IOException: Cannot obtain block length for LocatedBlock
- Writer——Writer的基本概念
- 许晓斌的《Maven实战》 maven镜像配置
- URAL1297Palindrome(最长回文子串 、后缀数组最长公共前缀+RMQ)
- Jess学习基础(一)
- 上传视频后获取真实地址_(qiniu)
- oracle 导入txt文件
- 详细解析oracle中left join,right join,inner join用法
- iOS 网络编程 (一)网络状态