sqoop错误
来源:互联网 发布:php abstract 继承 编辑:程序博客网 时间:2024/06/12 21:48
String url = "http://localhost:12000/sqoop/";SqoopClient client = new SqoopClient(url);//Creating dummy job objectMJob job = client.createJob("fromLinkName", "toLinkName");job.setName("Vampire");job.setCreationUser("Buffy");// set the "FROM" link job config valuesMFromConfig fromJobConfig = job.getFromJobConfig();fromJobConfig.getStringInput("fromJobConfig.schemaName").setValue("sqoop");fromJobConfig.getStringInput("fromJobConfig.tableName").setValue("sqoop");fromJobConfig.getStringInput("fromJobConfig.partitionColumn").setValue("id");// set the "TO" link job config valuesMToConfig toJobConfig = job.getToJobConfig();toJobConfig.getStringInput("toJobConfig.outputDirectory").setValue("/usr/tmp");// set the driver config valuesMDriverConfig driverConfig = job.getDriverConfig();driverConfig.getIntegerInput("throttlingConfig.numExtractors").setValue(3);
以上是官方文档中的job创建的代码,但运行是会抛出以下错误
Error: org.apache.sqoop.common.SqoopException:MAPRED_EXEC_0018:Error occurs during loader run atorg.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:292) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread PoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.sqoop.common.SqoopException: CORE_0000:An unknown error has occurred at org.apache.sqoop.utils.ClassUtils.executeWithClassLoader( ClassUtils.java:286) at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$Con sumerThread.run(SqoopOutputFormatLoadExecutor.java:259) ... 5 more Caused by: java.lang.NullPointerException at org.apache.sqoop.connector.hdfs.HdfsLoader.getExtension(H dfsLoader.java:161) at org.apache.sqoop.connector.hdfs.HdfsLoader.access$100(Hdf sLoader.java:45) at org.apache.sqoop.connector.hdfs.HdfsLoader$1.run(HdfsLoad er.java:86) at org.apache.sqoop.connector.hdfs.HdfsLoader$1.run(HdfsLoad er.java:60) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(User GroupInformation.java:1698) at org.apache.sqoop.connector.hdfs.HdfsLoader.load(HdfsLoade r.java:60) at org.apache.sqoop.connector.hdfs.HdfsLoader.load(HdfsLoade r.java:45) at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$Con sumerThread$1.call(SqoopOutputFormatLoadExecutor.java:279) at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$Con sumerThread$1.call(SqoopOutputFormatLoadExecutor.java:260 ) at org.apache.sqoop.utils.ClassUtils.executeWithClassLoader( ClassUtils.java:281) ... 6 more
原因是没有指定结果输出类型
应在
// set the “TO” link job config values下指定输出格式
toJobConfig.getInput("toJobConfig.outputFormat").setValue("TEXT_FILE");
阅读全文
0 0
- sqoop错误
- sqoop错误解决
- SQOOP连接SQLServer2005错误
- sqoop导入错误
- sqoop 错误记录
- sqoop常见错误
- Sqoop学习笔记 --- sqoop使用时候常见错误
- sqoop导入数据时间日期类型错误
- sqoop常见错误及解放方法
- sqoop连接mysql的一些错误
- sqoop导出mysql数据进入hive错误
- Sqoop常见错误及解决方式
- SQOOP
- Sqoop
- SQOOP
- SQOOP
- sqoop
- sqoop
- pat:L1-034. 点赞
- 周期循环图像边界算法
- Chapter 4
- SQL注入之联合注入
- 理解OAuth 2.0
- sqoop错误
- Android Studio 实用调试技巧
- sdut-1153 C语言实验——求两个整数之中较大者
- 第五章 广播机制
- hdu(poj)-2084(3176)-数塔-简单dp
- 第一次进行PCB设计
- 自制搜索(elasticsearch安装,mongo-connector同步数据,python操作)
- Android里java程序的编译启动
- linux介绍及基本指令