Hadoop 坑爹的Be Replicated to 0 nodes, instead of 1 异常
来源:互联网 发布:vfp 编程论坛 编辑:程序博客网 时间:2024/05/16 19:16
原文地址:http://dongyajun.iteye.com/blog/1039836
新的项目上线之后发现,有些会员上传资源到我们集群的速度,既然跟我们集群的吞吐量差不多,达到了70M+/s的速度。 在向集群put数据时,抛出了异常:
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /xxx/xxx/xx could only be replicated to 0 nodes, instead of 1这样的信息告诉我,集群内部无可用的节点了,因为是在put阶段出现的,直觉告诉我,所有的节点是不是都已经写满数据了?
节点少的情况比较容易观察Hadoop的一些问题,查看dfshealth.jsp页面发现,至少有三台节点可写,但dfsClient put数据仍然抛出无节点可用的异常。
追究源码,NameNode身边的 ReplicationTargetChooser#isGoodTarget方法给出了说明:
- Hadoop 坑爹的Be Replicated to 0 nodes, instead of 1 异常
- hadoop异常:Be Replicated to 0 nodes, instead of 1
- hadoop 在windows的Eclipse下运行出现 hadoop)could only be replicated to 0 nodes, instead of 1 异常
- hadoop异常“could only be replicated to 0 nodes, instead of 1” 解决
- Hadoop put 报异常“could only be replicated to 0 nodes, instead of 1”
- Hadoop 报异常“could only be replicated to 0 nodes, instead of 1”
- hadoop异常“could only be replicated to 0 nodes, instead of 1” 解决
- Hadoop异常之could only be replicated to 0 nodes, instead of 1
- hadoop异常“could only be replicated to 0 nodes, instead of 1” 解决
- Hadoop-异常“could only be replicated to 0 nodes, instead of 1”
- could only be replicated to 0 nodes, instead of 1
- Hadoop报错“could only be replicated to 0 nodes, instead of 1”
- Hadoop:File xxx could only be replicated to 0 nodes, instead of 1
- Hadoop配置:file could only be replicated to 0 nodes, instead of 1问题解决方法
- hadoop 报错be replicated to 0 nodes, instead of 1
- Hadoop报错“could only be replicated to 0 nodes, instead of 1” .
- hadoop could only be replicated to 0 nodes instead of 1 解决方法
- Hadoop上传文件报错 “could only be replicated to 0 nodes, instead of 1”
- hdu 1258_Sum It Up hdu
- JAVA连接MySQL
- hdu 1401双广
- hibernate二级缓存(包括注解方式)
- SVN常见问题与解决方法
- Hadoop 坑爹的Be Replicated to 0 nodes, instead of 1 异常
- Windows CE安装(转)
- iOS动态监听网络变化
- wince应用开发的一些小功能(备忘)
- Having trouble with a BeagleBoard GPIO interrupt pin
- 如何让listview滚动到底部
- oracle导入导出表exp以及创建用户和创建表空间
- RTSP 概述
- UINavigationController popToViewController直接返回指定级别页面