akka spark sbt依赖冲突

来源:互联网 发布:淘宝哪个返利多 编辑:程序博客网 时间:2024/06/14 17:01

打包akka和spark依赖时发生依赖冲突,根据http://www.cnblogs.com/scnu-ly/p/5106726.html的指导受到启发,但是文中的代码已经废弃了,查看官网,修改冲突jar包前缀后的配置文件文件如下:

libraryDependencies += "com.typesafe.akka" %% "akka-actor" % "2.5.0"libraryDependencies += "com.typesafe.akka" %% "akka-remote" % "2.5.0"libraryDependencies += "org.apache.spark" %% "spark-core" % "2.0.0" //% "provided"libraryDependencies += "org.apache.spark" %% "spark-mllib" % "2.0.0" //% "provided"// https://mvnrepository.com/artifact/com.typesafe.akka/akka-protobuf_2.11//libraryDependencies += "com.typesafe.akka" % "akka-protobuf_2.11" % "2.5.0"//libraryDependencies += "com.typesafe.akka" %% "akka-http" % "10.0.1"assemblyMergeStrategy in assembly := {  case PathList("org", "apache", xs @ _*)         => MergeStrategy.first  case PathList("javax", "inject", xs @ _*)         => MergeStrategy.first  case PathList("org", "aopalliance", xs @ _*)         => MergeStrategy.first  case PathList(ps@_*) if ps.last endsWith "axiom.xml" => MergeStrategy.filterDistinctLines  case PathList(ps@_*) if ps.last endsWith "Log$Logger.class" => MergeStrategy.first  case PathList(ps@_*) if ps.last endsWith "ILoggerFactory.class" => MergeStrategy.first  case x =>    val oldStrategy = (assemblyMergeStrategy in assembly).value    oldStrategy(x)}


原创粉丝点击