Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not se
来源：互联网 发布：直播音效软件下载 编辑：程序博客网 时间：2024/05/29 13:24
当从SparkSql得到的dataFrame，映射成RDD之后向hbase中直接保存数据的时候报错：
Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not set in JobConf.
采用的是saveAsNewApiHadoopDataSet
但是更换为saveAsHadoopDataset就可以使用，不知道在哪里出现了错误，对比发现应该是 没有使用sc.hadoopConfiguration,而是使用的JobConf 作为参数，新API不能用旧的configuration 。
0 0
- Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not se
- org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output alread
- hadoop解决Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/util/Apps
- cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://localhost:54310/u
- HIVE Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/CommandNee
- Exception in thread "main" org.apache.hadoop.security.AccessControlException: Permission denied: use
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/CommandNeedRetr
- 解决Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/ FSDataInputStream
- Exception in thread “main” java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop
- Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveExcept
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlExcep
- Exception in thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.io.nativeio.NativeIO$Win
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlExcep
- Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveExcept
- Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
- SPI通信
- Beginner
- 系统警告说REDO LOG Writer经常时间长 经常200多ms
- nw-git配合beyond的使用
- 经典js问题
- Exception in thread "main" org.apache.hadoop.mapred.InvalidJobConfException: Output directory not se
- 安卓自定义控件收集整理
- 字符串计数-求复合条件字典序个数
- 后台验证码
- 小米考试（电话号码）
- c
- UE4 Texture Streaming Pool 运行时红色显示关闭
- Leetcode 312. Burst Balloons[hard]
- FFmpeg视频转码技巧之二次编码
