Hadoop分布式集群 EclipseException in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputExce
来源:互联网 发布:爱迪生电弧打火机 淘宝 编辑:程序博客网 时间:2024/05/29 16:26
最近使用Hadoop分布式集群,今天在Ubuntu上将Eclipse和Hadoop配置好了,然后运行一个去重的案例,我将输入文件传到了hdfs文件系统,但是过程中出现了Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: 这个错误,显示从项目位置中查找输入文件,结果报错了,解决办法当然就是讲输入输出文件地址好好写了呗,代码如下:
// 设置输入和输出目录
FileInputFormat.addInputPath(job, new Path("hdfs://Master:9000/user/ycl1/input/inputfile1"));
FileOutputFormat.setOutputPath(job, new Path("hdfs://Master:9000/user/ycl1/output"));
重新运行一下,OK了。
这个路径是根据core-site.xml里面的fs.default.name来的。
阅读全文
0 0
- Hadoop分布式集群 EclipseException in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputExce
- org.apache.hadoop.mapreduce.lib.input包分析
- hadoop异常: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exi
- 错误:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost/
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException:input path does not exist:hdfs://10.0.2.
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
- hadoop解决Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/util/Apps
- TaggedInputSplit cannot be cast to org.apache.hadoop.mapreduce.lib.input.FileSplit
- java.lang.Exception: java.lang.ClassCastException: org.apache.hadoop.mapreduce.lib.input.TaggedInput
- HIVE Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/CommandNee
- Exception in thread "main" org.apache.hadoop.security.AccessControlException: Permission denied: use
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/CommandNeedRetr
- 解决Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/ FSDataInputStream
- Exception in thread “main” java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop
- 句柄是什么
- LeetCode.328 Odd Even Linked List
- 知名互联网公司系统架构图[第2期]
- MySQL server has gone away的问题解决
- [洛谷]P1082 同余方程
- Hadoop分布式集群 EclipseException in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputExce
- leetcode Clone Graph
- 使用Maven构建Spring输出你人生通过Spring输出的第一个HelloWord
- leetcode--532.K-DiffPairsInAnArray
- 解决Windows下启动mysql服务错误(系统进程意外终止,1067)
- 关于AIDL中的in、out和inout修饰符
- 如果在docker中部署tomcat,并且部署java应用程序
- 伪代码编程过程
- Json读写2017.9.23