cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://localhost:54310/u
来源:互联网 发布:java调用方法的方式 编辑:程序博客网 时间:2024/06/05 08:48
原文地址:http://hi.baidu.com/xucha00/item/16ac5f57ea3201c39e266751
12/05/28 09:33:37 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
12/05/28 09:33:37 INFO mapred.JobClient: Cleaning up the staging area file:/tmp/hadoop-Hadoop/mapred/staging/Hadoop-1983717839/.staging/job_local_0001
12/05/28 09:33:37 ERROR security.UserGroupInformation: PriviledgedActionException as:Hadoop (auth:SIMPLE) cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://localhost:54310/user/Hadoop/input/cxu_index already exists
Exception in thread "main" org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://localhost:54310/user/Hadoop/input/cxu_index already exists
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:132)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:872)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:476)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:506)
at com.payegis.caesar.hdfsindex.Main.main(Main.java:58)
==================================================================================================
hadoop 由于进行的是耗费资源的计算,生产的结果默认是不能被覆盖的,
因此中间结果输出目录一定不能存在,否则出现这个错误。
就是这句代码:
FileOutputFormat.setOutputPath( job, new Path(args[1]) );
- cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://localhost:54310/u
- org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output alread
- org.apache.hadoop.mapred.FileAlreadyExistsException
- org.apache.hadoop.mapred.FileAlreadyExistsException
- org.apache.hadoop.fs.FileAlreadyExistsException: Output directory hdfs://127.0.0.1:9000/user/hadoop/
- MapReduce运行异常-- org.apache.hadoop.mapred.FileAlreadyExistsException
- MapReduce运行异常– org.apache.hadoop.mapred.FileAlreadyExistsException
- Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not se
- FileAlreadyExistsException: Output directory hdfs://ubuntu:9000/output09 already exists
- Output directory hdfs://hadoop:8010/user/root/output already exists
- hadoop参数-hdfs-mapred
- hadoop参数-hdfs-mapred
- 错误:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost/
- org.apache.hadoop.mapred.InvalidInputException: Input path does not exist:
- Unknown protocol to name node: org.apache.hadoop.mapred.JobSubmissionProtocol
- eror---at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init
- org.apache.hadoop.mapred.YarnChild: GC overhead limit
- Hadoop Problem : Wrong FS: hdfs://localhost:9000/output, expected: file:///
- 设置frameset高度
- S3C44B0 u-boot和uclinux的编译
- [收藏]比较著名的.net技术论坛网址(含国外的)
- android流媒体框架介绍
- C++中类对象所占空间的大小
- cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://localhost:54310/u
- s5pv210----串口设置之输入输出字符
- win8下用grub2win安装ubuntu双系统
- nagios远程系统监测服务
- Spring事务配置的五种方式
- XHTML与CSS基础:(一)选择合适的doctype
- 在ubuntu下rails通过passenger安装nginx出错的原因
- CCS使用问题及解决方案
- Oracle的触发器学习笔记