hadoop Unable to load native-hadoop library --解决
来源:互联网 发布:c语言学生成绩管理删除 编辑:程序博客网 时间:2024/06/05 03:05
13/09/11 22:05:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
经常会出现这段代码,他可能会导致程序无法向下执行
网上对于这个问题有很错中说法
1,建立软链接
2,配置环境变量
export
3,配置JVM启动参数
-Djava.library.path=$HADOOP_HOME/lib/native/Linux-amd64-64
4,重新编译本地库包
ant compile-native
本人经过一一尝试,最终失败
解决方案:
修改core-site配置文件
<property>
<name>io.compression.codecs</name>
<value>org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec</value>
<description>A list of the compression codec classes that can be used
for compression/decompression.</description>
</property>
将压缩算法替换成自己能成功允许的算法即可
替代解决方案一:
将本地文件库里的.so文件上传到分布式文件系统,在程序中显式的加载调用
替代解决方案二
在网上下载某种压缩算法,然后拷贝到hadoop/lib下,user/local/lib,hadoop native labirary中,配置好访问路径
修改core-site配置文件
将压缩算法替换成刚下载的算法
如果程序执行成功:
13/09/11 22:20:06 INFO util.NativeCodeLoader: Loaded the native-hadoop library
13/09/11 22:20:06 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
祝您好运!
- hadoop Unable to load native-hadoop library --解决
- hadoop Unable to load native-hadoop library --解决
- hadoop Unable to load native-hadoop library
- Unable to load native-hadoop library for your platform解决
- 解决Unable to load native-hadoop library for your platform
- 解决 Unable to load native-hadoop library for your platform
- 解决 Unable to load native-hadoop library for your platform
- 解决Unable to load native-hadoop library for your platform
- 解决Unable to load native-hadoop library for your platform
- native-hadoop library本地库不一致解决: WARN util.NativeCodeLoader: Unable to load native-hadoop library
- Unable to load native-hadoop library
- Unable to load native-hadoop library
- Unable to load native-hadoop library
- Unable to load native-hadoop library 和 Snappy native library not loaded 的解决
- hadoop Unable to load native-hadoop library for your platform
- 解决Unable to load native-hadoop
- 解决hadoop Unable to load native-hadoop library for your platform...
- 解决 hadoop fs -ls / Unable to load native-hadoop library for your platform
- 修复由TortoiseSVN引起的bat文件关联异常
- 用jxl 从jsp页面导出数据到excel表格并下载保存
- Win7设置FTP详细过程
- android 中chromium_org模块打log的方法
- mtd块设备缓冲操作---mtdblock.c
- hadoop Unable to load native-hadoop library --解决
- windows下实现微秒级延时
- CXF javax.xml.ws.soap.SOAPFaultException: Fault occurred while processing
- 改善代码质量的6种重构模式
- 开源游戏3D引擎之Godot的专用脚本语言
- 书籍总结
- Struts2注解Convention扫描jar中的Action的设置
- 利用Cookie统计UV流量
- Question