hadoop:slf4j-log4j12-1.7.5.jar 和 hdfs dfs -put 问题的解决
来源:互联网 发布:未来清单软件多少钱 编辑:程序博客网 时间:2024/06/06 20:54
问题1:
[root@master hadoop-2.6.0]# hdfs dfs -mkdir -p /bigdatacaseSLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in [jar:file:/opt/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: Found binding in [jar:file:/home/fhx/hbase-1.2.4/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
解决方法:
/home/fhx/hbase-1.2.4/lib/ rm -rf slf4j-log4j12-1.7.5.jar
注意看报错内容
类路径含有多个slf4j-log4j12-1.7.5.jar
本来应该是hadoop路径下的,hbase也有,造成了困扰,因此找到Hbase下的slf4j-log4j12-1.7.5.jar并删除
问题2
[root@master hadoop-2.6.0]# hdfs dfs -put /usr/local/bigdatacase/dataset/user_table.txt /bigdatacase/dataset17/12/10 14:07:49 WARN hdfs.DFSClient: DataStreamer Exceptionorg.apache.hadoop.ipc.RemoteException(java.io.IOException): File /bigdatacase/dataset/user_table.txt._COPYING_ could only be replicated to 0 nodes instead of minReplication (=1). There are 0 datanode(s) running and no node(s) are excluded in this operation. at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1549) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3200) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:641) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:482) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2039) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2035) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2033) at org.apache.hadoop.ipc.Client.call(Client.java:1468) at org.apache.hadoop.ipc.Client.call(Client.java:1399) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at com.sun.proxy.$Proxy9.addBlock(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:399) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy10.addBlock(Unknown Source) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1532) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1349) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:588)put: File /bigdatacase/dataset/user_table.txt._COPYING_ could only be replicated to 0 nodes instead of minReplication (=1). There are 0 datanode(s) running and no node(s) are excluded in this operation.
解决方法:
将hadoop数据区赋予写的权限
找了好多解决方案均无效,最后被修改权限拯救
阅读全文
0 0
- hadoop:slf4j-log4j12-1.7.5.jar 和 hdfs dfs -put 问题的解决
- 阿里云ACE上碰到的坑log4j-over-slf4j.jar和slf4j-log4j12.jar冲突问题,我去……
- hbase问题 slf4j-log4j12
- 《Springboot极简教程》问题解决:Idea解决Gradle库依赖冲突问题:Detected both log4j-over-slf4j.jar AND slf4j-log4j12.jar on the class path, preempting
- storm出现log4j-over-slf4j.jar和slf4j-log4j12.jar冲突
- curator-x-rpc-2.9.1.jar和slf4j-api-1.5.2、slf4j-log4j12-1.5.2冲突
- Detected both log4j-over-slf4j.jar AND slf4j-log4j12.jar
- Detected both log4j-over-slf4j.jar AND slf4j-log4j12.jar
- Detected both log4j-over-slf4j.jar AND slf4j-log4j12.jar
- log4j-over-slf4j.jar 与slf4j-log4j12.jar 依赖冲突
- slf4j-api、slf4j-log4j12、log4j的关系
- 13.4 库依赖冲突问题:Detected both log4j-over-slf4j.jar AND bound slf4j-log4j12.jar on the class path
- 日志系统jar包:slf4j-api, slf4j-log4j12以及log4j
- 日志系统jar包:slf4j-api, slf4j-log4j12以及log4j
- 解决was8.5下自带log4j和slf4j的jar包与应用中jar包冲突问题
- Hadoop dfs -put 失败
- ActiveMQ错误 jar包冲突(slf4j-log4j12.jar slf4j-api.jar log4j.jar )
- hadoop2.5.2中执行 $ bin/hdfs dfs -put etc/hadoop input遇到put: `input': No such file or directory的解决办法
- 理解多线程设计模式(转)
- mybatis中#{}与${}的区别
- 菜鸟wz的Python周记(1) ——位运算
- 坚持#第238天~开始接触shell脚本了
- 线程和进程的区别?以及如何实现多线程
- hadoop:slf4j-log4j12-1.7.5.jar 和 hdfs dfs -put 问题的解决
- TCP/IP理论基础
- 开源控件material-calendarview的使用
- 蓝桥杯题解-凑算式(全排列变体)
- 菜鸟wz的Python周记(2)——冒泡
- 数据库查询null值时的SQL处理
- 编写多线程程序,模拟多个人通过一个山洞。这个山洞每次只能通过一个人,每个人通过山洞的时间为2秒(sleep)。随机生成10个人,都要通过此山洞,用随机值对应的字符串表示人名,打印输出
- Mac中用matplotlib绘图,中文显示乱码
- eclipse 安装spring 插件