org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output alread
来源:互联网 发布:省流量的软件 编辑:程序博客网 时间:2024/06/05 05:48
[hadoop@djtNode1 bin]$ ./hadoop jar ~/app/test/analysis-1.0-SNAPSHOT.jar pv /input/test.txt /output16/04/30 16:25:09 WARN security.UserGroupInformation: PriviledgedActionException as:hadoop (auth:SIMPLE) cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output already existsorg.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output <strong>already exists</strong>at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:146)at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562)at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1306)at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1303)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)at org.apache.hadoop.mapreduce.Job.submit(Job.java:1303)at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1324)at com.dajiangtai.Pv.main(Pv.java:67)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)at com.dajiangtai.MyDriver.main(MyDriver.java:25)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.hadoop.util.RunJar.run(RunJar.java:221)at org.apache.hadoop.util.RunJar.main(RunJar.java:136)该问题是因为在hdfs中已经存在了 /output文件夹,将其删除,重新运行即可。
0 0
- org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output alread
- cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://localhost:54310/u
- org.apache.hadoop.fs.FileAlreadyExistsException: Output directory hdfs://127.0.0.1:9000/user/hadoop/
- org.apache.hadoop.mapred.FileAlreadyExistsException
- org.apache.hadoop.mapred.FileAlreadyExistsException
- Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not se
- FileAlreadyExistsException: Output directory hdfs://ubuntu:9000/output09 already exists
- MapReduce运行异常-- org.apache.hadoop.mapred.FileAlreadyExistsException
- MapReduce运行异常– org.apache.hadoop.mapred.FileAlreadyExistsException
- Output directory hdfs://hadoop:8010/user/root/output already exists
- mapred.output.compression.codec
- hadoop 2.7.4:java.lang.UnsupportedClassVersionError: org/apache/hadoop/mapreduce/lib/output/Sequence
- hadoop参数-hdfs-mapred
- hadoop参数-hdfs-mapred
- Hadoop Problem : Wrong FS: hdfs://localhost:9000/output, expected: file:///
- org.apache.hadoop.mapred.InvalidInputException: Input path does not exist:
- Unknown protocol to name node: org.apache.hadoop.mapred.JobSubmissionProtocol
- eror---at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init
- PHP中new出来的对象和 clone复制出来的对象
- C#中Split用法(把字符串以某个字符为分隔符分成一个数组)
- eclipse svn同步程序报错 Attempted to lock an already-locked dir(使用此方法已经解决问题)
- Codeforces Round #334 (Div. 2) D. Moodular Arithmetic
- SAP ABAP编程 获取物料长文本-其他长文本同理
- org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output alread
- JavaSE入门学习34:Java集合框架之Collection接口、子接口及其实现类
- Struts中ActionContext和ServletActionContext的比较 [转]
- c#调用c++制作的基于mfc的ocx控件
- enjoy_game服务端
- leetcode 055 Jump Game
- Object-C 中各数据类型转换 NSData转NSString,Byte,UIImage
- UIView
- 【Stanford机器学习笔记】4-Regularization for Solving the Problem of Overfitting