JavaEsSpark.esJsonRDD函数读取ES数据报错

错误信息如下

Exception in thread "main" org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only'      at org.elasticsearch.hadoop.rest.InitializationUtils.discoverEsVersion(InitializationUtils.java:196)      at org.elasticsearch.hadoop.rest.RestService.findPartitions(RestService.java:231)      at org.elasticsearch.spark.rdd.AbstractEsRDD.esPartitions$lzycompute(AbstractEsRDD.scala:61)      at org.elasticsearch.spark.rdd.AbstractEsRDD.esPartitions(AbstractEsRDD.scala:60)      at org.elasticsearch.spark.rdd.AbstractEsRDD.getPartitions(AbstractEsRDD.scala:27)      at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:239)      at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:237)      at scala.Option.getOrElse(Option.scala:120)      at org.apache.spark.rdd.RDD.partitions(RDD.scala:237)      at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:35)      at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:239)      at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:237)      at scala.Option.getOrElse(Option.scala:120)      at org.apache.spark.rdd.RDD.partitions(RDD.scala:237)      at org.apache.spark.rdd.RDD$$anonfun$take$1.apply(RDD.scala:1307)      at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)      at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:111)      at org.apache.spark.rdd.RDD.withScope(RDD.scala:316)      at org.apache.spark.rdd.RDD.take(RDD.scala:1302)      at org.apache.spark.rdd.RDD$$anonfun$first$1.apply(RDD.scala:1342)      at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)      at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:111)      at org.apache.spark.rdd.RDD.withScope(RDD.scala:316)      at org.apache.spark.rdd.RDD.first(RDD.scala:1341)      at com.anchiva.test.TestEs$.main(TestEs.scala:17)      at com.anchiva.test.TestEs.main(TestEs.scala)      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)      at java.lang.reflect.Method.invoke(Method.java:601)      at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)  Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Unsupported/Unknown Elasticsearch version 5.0.0      at org.elasticsearch.hadoop.rest.InitializationUtils.discoverEsVersion(InitializationUtils.java:191)      ... 30 more  

查了一圈儿资料，原因是我使用的jar包版本有误，原来用的elasticsearch-spark_2.11，pom引用如下

<!-- https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-spark --><dependency>    <groupId>org.elasticsearch</groupId>    <artifactId>elasticsearch-spark_2.11</artifactId>    <version>2.4.5</version></dependency>

改成elasticsearch-spark-20_2.11就可以了，pom引用如下

<!-- https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-spark-20 --><dependency>    <groupId>org.elasticsearch</groupId>    <artifactId>elasticsearch-spark-20_2.11</artifactId>    <version>5.6.4</version></dependency>