安装sqoop-1.99.7报caused by java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
来源:互联网 发布:司马辽太郎 知乎 编辑:程序博客网 时间:2024/06/05 09:52
最近在学习sqoop,我以前用过sqoop-1.4.4版本,最近想学习最新版sqoop-1.99.7,在网上找了安装教程,安装完后用
#sqoop2-tool verify命令进行验证,结果报caused by java.lang.ClassNotFoundException:org.apache.hadoop.conf.Configuration
这个错误,明显是sqoop没有找到hadoop的路径,有网友说把hadoop的jar包拷贝到sqoop目录下,这种方法是最笨的方法,不建议。
既然是路径的问题,我们就去修改路径,打开sqoop脚本文件,#vim sqoop.sh
进入编辑模式以后,找到一下几行:
HADOOP_COMMON_HOME=${HADOOP_COMMON_HOME:-${HADOOP_HOME}/share/hadoop/common}
HADOOP_HDFS_HOME=${HADOOP_HDFS_HOME:-${HADOOP_HOME}/share/hadoop/hdfs}
HADOOP_MAPRED_HOME=${HADOOP_MAPRED_HOME:-${HADOOP_HOME}/share/hadoop/mapreduce}
HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-${HADOOP_HOME}/share/hadoop/yarn}
如果没猜错的话,你当时在安装hadoop时,在系统环境变量/etc/profile文件中除了定义了HADOOP_HOME,还定义其他,例如HADOOP_COMMON_HOME等等,这样的话,就会导致很多莫名的错误,也许sqoop找不到hadoop的路径就是这个原因
所以解决办法就是,把上面sqoop.sh中的那四行代码改成
HADOOP_COMMON_HOME=${HADOOP_HOME}/share/hadoop/common
HADOOP_HDFS_HOME=${HADOOP_HOME}/share/hadoop/hdfs
HADOOP_MAPRED_HOME=${HADOOP_HOME}/share/hadoop/mapreduce
HADOOP_YARN_HOME=${HADOOP_HOME}/share/hadoop/yarn
为了保险起见,可以把${HADOOP_HOME}也换成绝对路径(例如: HADOOP_COMMON_HOME=/home/lvyuan/hadoop-2.6.0/share/hadoop/common),然后再#sqoop2-tool verify
就验证通过了
sqoop-1.99.7安装教程参见这篇博客http://blog.csdn.net/u012842205/article/details/52344196
- 安装sqoop-1.99.7报caused by java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
- flume报错Caused by: java.lang.ClassNotFoundException: org.apache.flume.tools.GetJavaProperty
- Caused by: java.lang.ClassNotFoundException:org.apache.commons.logging.LogFactory
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.FileUtils
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.fileupload.RequestContext
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
- Caused by: java.lang.ClassNotFoundException:org.apache.commons.logging.LogFactory
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
- Caused by: java.lang.ClassNotFoundException: org.apache.log4j.DefaultThrowableRenderer
- Caused by: java.lang.ClassNotFoundException: org.apache.shiro.spring.LifecycleBeanPostProcessor
- Caused by: java.lang.ClassNotFoundException: org.apache.axiom.om.OMNode
- Caused by: java.lang.ClassNotFoundException: org.apache.neethi.Policy
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.collections.ExtendedProperties
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
- Caused by: java.lang.ClassNotFoundException: org.apache.ibatis.mapping.DatabaseIdProvider
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
- Caused by: java.lang.ClassNotFoundException: org.apache.commons.dbcp.BasicDataSource
- Java集合关系图
- 成为一个有目标的学习者
- [LeetCode]119 Pascal's Triangle II
- nmake fatal error u1077:path/c1.exe 返回代码0x2解决思路
- 程序员面试金典-5.6找出缺失的部分
- 安装sqoop-1.99.7报caused by java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
- Android仿微信图片上传,可以选择多张图片,缩放预览,拍照上传等
- Android使用Cordova框架开发Android Hybrid App
- docker (一)
- nginx文档
- linux命令
- Ubuntu下apt-get与pip安装命令的区别
- hdu1584 蜘蛛牌
- python3.X实现socket编程的小处理