#org.apache.hadoop.conf.Configuration.addDeprecations
来源:互联网 发布:ios横版动作游戏 知乎 编辑:程序博客网 时间:2024/05/29 04:53
若在spark-dafult.conf里配置spark.driver.extraClassPath /usr/local/spark/lib/*
会报:
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.addDeprecations([Lorg/apache/hadoop/conf/Configuration$DeprecationDelta;)V at org.apache.hadoop.yarn.conf.YarnConfiguration.addDeprecatedKeys(YarnConfiguration.java:79) at org.apache.hadoop.yarn.conf.YarnConfiguration.<clinit>(YarnConfiguration.java:73) at org.apache.spark.deploy.yarn.YarnSparkHadoopUtil.newConfiguration(YarnSparkHadoopUtil.scala:61) ......
若spark-dafult.conf配置为spark.driver.extraClassPath [其他路径]
就不会报错
若spark-dafult.conf配置为 spark.driver.extraClassPath /usr/local/spark/lib/spark-1.5.1-yarn-shuffle.jar
还是会报classpath冲突的错
所以报org.apache.hadoop.conf.Configuration.addDeprecations有可能是spark-assembly-1.5.1-hadoop2.6.0.jar双重引用
0 0
- #org.apache.hadoop.conf.Configuration.addDeprecations
- org.apache.hadoop.conf.Configuration.getFloat(String arg0, float arg1)
- org.apache.hadoop.conf
- ERROR org.apache.hadoop.conf.Configuration: Failed to set setXIncludeAware(true) for parser
- spark插入数据到hbase: org.apache.hadoop.conf.Configuration not Serializable Exeception
- 安装sqoop-1.99.7报caused by java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
- 【hadoop hive】hive启动报错java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.unset(Ljava/l
- Hadoop源码详解 org.apache.hadoop.conf (配置类) (二)
- 1.hadoop学习之org.apache.hadoop.conf
- java:5: error: package org.apache.hadoop.conf does not
- hadoop源码分析系列之(一)——org.apache.hadoop.conf包
- hadoop源码分析系列之(一)——org.apache.hadoop.conf包
- org.apache.commons.configuration.Configuration 配置文件
- hive报错 java.lang.NoClassDefFoundError: org/apache/hadoop/hive/conf/HiveConf
- sqoop把mysql导入hive时报错:Could not load org.apache.hadoop.hive.conf.HiveConf.
- hadoop 出现FATAL conf.Configuration: error parsing conf file,异常
- org.apache.hadoop.io
- java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration
- Zedboard上运行Linaro系统(四):文件系统
- [Java基础笔记]线程部分
- Spring源码导入Eclipse
- Java学习笔记_day1
- 二级tableView联动
- #org.apache.hadoop.conf.Configuration.addDeprecations
- java开发命名规范
- 浅谈a伪类选择器的书写顺序
- Activity之间用 intent.putExtra传值,bundle.getString取值为空null
- ios强制横屏
- idea快捷键
- CentOS下配置ODBC连接MySQL数据库 V2.0
- TensorFlow 训练 MNIST 数据(二)
- 自定义Vie