Spark 开发环境搭建（1）IDEA Gradle的安装部署、使用

Spark 开发环境搭建（1）使用IDEA Gradle的方式

1，JAVA环境检查

 C:\Windows\System32>java -versionjava version "1.8.0_121"Java(TM) SE Runtime Environment (build 1.8.0_121-b13)Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)C:\Windows\System32>

2，gradle下载安装

下载地址：https://gradle.org/releases安装版本：gradle v3.5下载到本地：G:\1.BeiJingSpark\201704BeiJingSetupTools将gradle-3.5-all.zip文件解压缩，并将文件复制到E:\Program Files目录下，进入bin目录E:\Program Files\gradle-3.5-all\gradle-3.5\bin>验证测试：E:\Program Files\gradle-3.5-all\gradle-3.5\bin>gradle -version------------------------------------------------------------Gradle 3.5------------------------------------------------------------Build time:   2017-04-10 13:37:25 UTCRevision:     b762622a185d59ce0cfc9cbc6ab5dd22469e18a6Groovy:       2.4.10Ant:          Apache Ant(TM) version 1.9.6 compiled on June 29 2015JVM:          1.8.0_121 (Oracle Corporation 25.121-b13)OS:           Windows 7 6.1 amd64E:\Program Files\gradle-3.5-all\gradle-3.5\bin>

3， 设置gradle环境变量

我的电脑-高级系统属性-环境变量-设置绝对路径：GRADLE_HOME  E:\Program Files\gradle-3.5-all\gradle-3.5 PATH  E:\Program Files\gradle-3.5-all\gradle-3.5\bin; 

4,重启电脑，检查gradle安装成功

C:\Windows\System32>gradle -version------------------------------------------------------------Gradle 3.5------------------------------------------------------------Build time:   2017-04-10 13:37:25 UTCRevision:     b762622a185d59ce0cfc9cbc6ab5dd22469e18a6Groovy:       2.4.10Ant:          Apache Ant(TM) version 1.9.6 compiled on June 29 2015JVM:          1.8.0_121 (Oracle Corporation 25.121-b13)OS:           Windows 7 6.1 amd64C:\Windows\System32>

5，在IDEA中创建gradle 项目

6，IDEA gradle 使用测试案例

单项目构建的一个例子：

settings.gradle文件： 

rootProject.name = 'SparkUseGradle'println 'BeiJing This is executed during the initialization phase.'

build.gradle文件配置： 

group 'SparkUseGradle'version '1.0-SNAPSHOT'apply plugin: 'java'sourceCompatibility = 1.5repositories {    mavenCentral()}dependencies {    testCompile group: 'junit', name: 'junit', version: '4.11'}//////////////////////println 'BeiJing This is executed during the configuration phase.'task configured {    println 'BeiJing This is also executed during the configuration phase.'}task BeiJingtest << {    println 'BeiJing This is executed during the execution phase.'}task BeiJingtestBoth {    doFirst {        println 'BeiJing This is executed first during the execution phase.'    }    doLast {        println 'BeiJing This is executed last during the execution phase.'    }    println 'BeiJing This is executed during the configuration phase as well.'}

分别在IDEA和windows cmd命令行中运行结果如下：

Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use --status for detailsBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.:helpWelcome to Gradle 3.5.To run a build, run gradle <task> ...To see a list of available tasks, run gradle tasksTo see a list of command-line options, run gradle --helpTo see more detail about a task, run gradle help --task <task>BUILD SUCCESSFULTotal time: 10.028 secsProcess finished with exit code 0

在cmd中运行如下：

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle BeiJingtest BeiJingtestBothStarting a Gradle Daemon, 1 incompatible Daemon could not be reused, use --status for detailsBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.:BeiJingtestBeiJing This is executed during the execution phase.:BeiJingtestBothBeiJing This is executed first during the execution phase.BeiJing This is executed last during the execution phase.BUILD SUCCESSFULTotal time: 8.68 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

7,Gradle构建基础
task hello {    doLast {        println 'task hello :   Hello world,Hello BeiJing !'    }}//这是快捷写法，用<<替换doLast，后面解释task hl << {    println 'task h1 <<:   Hello world!,Welcome to BeiJing!'}//创建upper的task，使用Groovy语言编写task upper << {    String someString = 'mY_nAmE_beijING'    println "task upper Original:   " + someString    println "task Upper case: " + someString.toUpperCase()}

在windows cmd中分别运行：
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle upperBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.:uppertask upper Original:   mY_nAmE_beijINGtask Upper case: MY_NAME_BEIJINGBUILD SUCCESSFULTotal time: 2.338 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle hlBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.:hltask h1 <<:   Hello world!,Welcome to BeiJing!BUILD SUCCESSFULTotal time: 2.324 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle helloBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.:hellotask hello :   Hello world,Hello BeiJing !BUILD SUCCESSFULTotal time: 2.549 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

在IDEA可以指定运行的脚本任务

 在idea中运行如下：

BeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.:uppertask upper Original:   mY_nAmE_beijINGtask Upper case: MY_NAME_BEIJINGBUILD SUCCESSFUL

task有无action的区别，如果task没有加<<则这个任务在脚本初始化initialization阶段 被执行，如果加了<<则在gradle actionTask后才执行。如下：

//有Action的tasktask actionTask << {    println 'I am actionTask'}//无Action的tasktask noActionTask {    println 'I am noActionTask'}

在idea中运行如下：

 BeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.I am noActionTask:actionTaskI am actionTaskBUILD SUCCESSFULTotal time: 3.046 secsProcess finished with exit code 0

8，任务task依赖：

一个build.gradle文件中多个task如果互相没有关系，则在gradle命令配置task参数运行；
如果多个任务之间如果有依赖关系，如下：

task taskX(dependsOn: 'taskY') << {    println 'taskX'}task taskY << {    println 'taskY'}

在IDEA中运行结果如下：

BeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.I am noActionTask:taskYtaskY:taskXtaskXBUILD SUCCESSFULTotal time: 2.839 secsProcess finished with exit code 0

9，动态任务task： 

task count << {    4.times { print "$it " }}4.times { counter ->    task "task$counter" << {        println "I'm task number $counter"    }}

在idea中运行如下

BeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.I am noActionTask:task2I'm task number 2

在windows cmd中运行

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle task0Starting a Gradle Daemon, 1 incompatible and 2 stopped Daemons could not be reused, use --status for detailsBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.I am noActionTask:task0I'm task number 0BUILD SUCCESSFULTotal time: 8.221 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle task3BeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.I am noActionTask:task3I'm task number 3BUILD SUCCESSFULTotal time: 2.339 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

使用已存在任务task：

4.times { counter ->    task "task$counter" << {        println "I'm task number $counter"    }}task0.dependsOn task2, task3

在cmd中运行

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle task0BeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)BeiJing This is executed during the configuration phase as well.I am noActionTask:task2I'm task number 2:task3I'm task number 3:task0I'm task number 0BUILD SUCCESSFULTotal time: 2.53 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

可以通过API为任务加入一些新行为，如下：

task hello2 << {    println 'Hello Earth'}hello2.doFirst {    println 'Hello Venus'}hello2.doLast {    println 'Hello Mars'}hello2 << {    println 'Hello Jupiter'}

在IDEA中运行

:hello2Hello VenusHello EarthHello MarsHello Jupiter

任务task短标记：：

task hello3 << {    println 'Hello world!'}hello3.doLast {    println "Greetings from the $hello3.name task."}

在IDEA中运行

:hello3Hello world!Greetings from the hello3 task.

自定义任务task属性：

task myTask {    ext.myProperty = "myValue"}task printTaskProperties << {    println myTask.myProperty}

在IDEA中运行

:printTaskPropertiesmyValueBUILD SUCCESSFULTotal time: 3.01 secs

定义默认任务task：

defaultTasks 'clean1', 'run1'task clean1 << {    println 'Default Cleaning!'}task run1 << {    println 'Default Running!'}task other1 << {    println "I'm not a default task!"}

在idea中运行

:clean1Default Cleaning!:run1Default Running!BUILD SUCCESSFULTotal time: 2.782 secs

10，Gradle依赖管理基础：

Gradle依赖声明：

group 'SparkUseGradle'version '1.0-SNAPSHOT'apply plugin: 'java'sourceCompatibility = 1.5repositories {    mavenCentral()}dependencies {    testCompile group: 'junit', name: 'junit', version: '4.11'}

compile 
用来编译项目源代码的依赖；

runtime 
在运行时被生成的类需要的依赖，默认项，包含编译时的依赖；

testCompile
编译测试代码依赖，默认项，包含生成的类运行所需的依赖和编译源代码的依赖；


Gradle外部依赖：external dependency：是在当前构建之外的一种依赖，一般存放在远程（Maven）或本地的仓库里。如下是一个外部依赖的例子：

dependencies {    // https://mvnrepository.com/artifact/org.apache.spark/spark-core_2.11    compile group: 'org.apache.spark', name: 'spark-core_2.11', version: '2.1.0'    testCompile group: 'junit', name: 'junit', version: '4.11'}

保存，自动下载

Gradle仓库：Gradle在一个仓库（repository）里找依赖文件 

repositories {    mavenCentral()}

远程库

repositories {    maven {        url "http://repo.mycompany.com/maven2"    }}

本地文件系统

repositories {    ivy {        // URL can refer to a local directory        url "../local-repo"    }}

Gradle发布artifacts：

apply plugin: 'maven'uploadArchives {    repositories {        mavenDeployer {            repository(url: "file://E:/SparkGradle2017/tmp/myRepo/")        }    }}

Gradle命令
gradle projects命令：列出子项目名称列表。
gradle tasks命令：列出项目中所有任务。
gradle help –task someTask命令：可以显示指定任务的详细信息。
gradle dependencies命令：列出项目的依赖列表，所有依赖会根据任务区分，以树型结构展示。

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle projectsStarting a Gradle Daemon, 1 incompatible and 1 stopped Daemons could not be reused, use --status for detailsBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:37)BeiJing This is executed during the configuration phase as well.I am noActionTask:projects------------------------------------------------------------Root project------------------------------------------------------------Root project 'SparkUseGradle'No sub-projectsTo see a list of the tasks of a project, run gradle <project-path>:tasksFor example, try running gradle :tasksBUILD SUCCESSFULTotal time: 9.097 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle tasksBeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:37)BeiJing This is executed during the configuration phase as well.I am noActionTask:tasks------------------------------------------------------------All tasks runnable from root project------------------------------------------------------------Default tasks: clean1, run1Build tasks-----------assemble - Assembles the outputs of this project.build - Assembles and tests this project.buildDependents - Assembles and tests this project and all projects that dependon it.buildNeeded - Assembles and tests this project and all projects it depends on.classes - Assembles main classes.clean - Deletes the build directory.jar - Assembles a jar archive containing the main classes.testClasses - Assembles test classes.Build Setup tasks-----------------init - Initializes a new Gradle build.wrapper - Generates Gradle wrapper files.Documentation tasks-------------------javadoc - Generates Javadoc API documentation for the main source code.Help tasks----------buildEnvironment - Displays all buildscript dependencies declared in root project 'SparkUseGradle'.components - Displays the components produced by root project 'SparkUseGradle'.[incubating]dependencies - Displays all dependencies declared in root project 'SparkUseGradle'.dependencyInsight - Displays the insight into a specific dependency in root project 'SparkUseGradle'.dependentComponents - Displays the dependent components of components in root project 'SparkUseGradle'. [incubating]help - Displays a help message.model - Displays the configuration model of root project 'SparkUseGradle'. [incubating]projects - Displays the sub-projects of root project 'SparkUseGradle'.properties - Displays the properties of root project 'SparkUseGradle'.tasks - Displays the tasks runnable from root project 'SparkUseGradle'.Upload tasks------------uploadArchives - Uploads all artifacts belonging to configuration ':archives'Verification tasks------------------check - Runs all checks.test - Runs the unit tests.Rules-----Pattern: clean<TaskName>: Cleans the output files of a task.Pattern: build<ConfigurationName>: Assembles the artifacts of a configuration.Pattern: upload<ConfigurationName>: Assembles and uploads the artifacts belonging to a configuration.To see all tasks and more detail, run gradle tasks --allTo see more detail about a task, run gradle help --task <task>BUILD SUCCESSFULTotal time: 2.682 secsG:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

 查看依赖关系

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle dependencies >d:\20170422.txt

依赖关系结果如下

BeiJing This is executed during the initialization phase.BeiJing This is executed during the configuration phase.BeiJing This is also executed during the configuration phase.The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:37)BeiJing This is executed during the configuration phase as well.I am noActionTask:dependencies------------------------------------------------------------Root project------------------------------------------------------------apiElements - API elements for main. (n)No dependenciesarchives - Configuration for archive artifacts.No dependenciescompile - Dependencies for source set 'main' (deprecated, use 'implementation ' instead).\--- org.apache.spark:spark-core_2.11:2.1.0     +--- org.apache.avro:avro-mapred:1.7.7     |    +--- org.apache.avro:avro-ipc:1.7.7     |    |    +--- org.apache.avro:avro:1.7.7     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6     |    |    |    +--- org.apache.commons:commons-compress:1.4.1     |    |    |    |    \--- org.tukaani:xz:1.0     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     +--- com.twitter:chill_2.11:0.8.0     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- com.twitter:chill-java:0.8.0     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3     |    |         +--- com.esotericsoftware:minlog:1.3.0     |    |         \--- org.objenesis:objenesis:2.1     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)     +--- com.twitter:chill-java:0.8.0 (*)     +--- org.apache.xbean:xbean-asm5-shaded:4.4     +--- org.apache.hadoop:hadoop-client:2.2.0     |    +--- org.apache.hadoop:hadoop-common:2.2.0     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- org.apache.commons:commons-math:2.1     |    |    +--- xmlenc:xmlenc:0.52     |    |    +--- commons-httpclient:commons-httpclient:3.1     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-net:commons-net:3.1     |    |    +--- log4j:log4j:1.2.17     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- commons-configuration:commons-configuration:1.6     |    |    |    +--- commons-collections:commons-collections:3.2.1     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5     |    |    |    +--- commons-digester:commons-digester:1.8     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-api:1.7.16     |    |    |    \--- log4j:log4j:1.2.17     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    +--- commons-codec:commons-codec:1.4     |    |    |    +--- log4j:log4j:1.2.17     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17     |    |    |    \--- jline:jline:0.9.94     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- log4j:log4j:1.2.17     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    \--- xmlenc:xmlenc:0.52     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0     |    |    |    |    +--- log4j:log4j:1.2.17     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    |    \--- com.google.inject:guice:3.0     |    |    |    |    |         +--- javax.inject:javax.inject:1     |    |    |    |    |         +--- aopalliance:aopalliance:1.0     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0     +--- org.apache.spark:spark-launcher_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0     |    |    +--- org.scalatest:scalatest_2.11:2.2.6     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8     |    |    \--- org.spark-project.spark:unused:1.0.0     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-common_2.11:2.1.0     |    +--- io.netty:netty-all:4.0.42.Final     |    +--- org.apache.commons:commons-lang3:3.5     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)     |    +--- io.dropwizard.metrics:metrics-core:3.1.2     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-unsafe_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    +--- com.twitter:chill_2.11:0.8.0 (*)     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    \--- org.spark-project.spark:unused:1.0.0     +--- net.java.dev.jets3t:jets3t:0.7.1     |    +--- commons-codec:commons-codec:1.3 -> 1.4     |    \--- commons-httpclient:commons-httpclient:3.1 (*)     +--- org.apache.curator:curator-recipes:2.4.0     |    +--- org.apache.curator:curator-framework:2.4.0     |    |    +--- org.apache.curator:curator-client:2.4.0     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    \--- com.google.guava:guava:14.0.1     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    \--- com.google.guava:guava:14.0.1     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    \--- com.google.guava:guava:14.0.1     +--- javax.servlet:javax.servlet-api:3.1.0     +--- org.apache.commons:commons-lang3:3.5     +--- org.apache.commons:commons-math3:3.4.1     +--- com.google.code.findbugs:jsr305:1.3.9     +--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jul-to-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jcl-over-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- log4j:log4j:1.2.17     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)     +--- com.ning:compress-lzf:1.0.3     +--- org.xerial.snappy:snappy-java:1.1.2.6     +--- net.jpountz.lz4:lz4:1.3.0     +--- org.roaringbitmap:RoaringBitmap:0.5.11     +--- commons-net:commons-net:2.2 -> 3.1     +--- org.scala-lang:scala-library:2.11.8     +--- org.json4s:json4s-jackson_2.11:3.2.11     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    +--- org.json4s:json4s-core_2.11:3.2.11     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6     |    |    \--- org.scala-lang:scalap:2.11.0     |    |         \--- org.scala-lang:scala-compiler:2.11.0     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)     +--- org.glassfish.jersey.core:jersey-client:2.22.2     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    |    +--- javax.annotation:javax.annotation-api:1.2     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34     |    |    |    +--- javax.inject:javax.inject:1     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34     |    |    |    |    \--- javax.inject:javax.inject:1     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)     |    |    |    \--- org.javassist:javassist:3.18.1-GA     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     +--- org.glassfish.jersey.core:jersey-server:2.22.2     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- javax.annotation:javax.annotation-api:1.2     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    \--- javax.validation:validation-api:1.1.0.Final     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)     +--- io.netty:netty-all:4.0.42.Final     +--- io.netty:netty:3.8.0.Final     +--- com.clearspring.analytics:stream:2.7.0     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     +--- io.dropwizard.metrics:metrics-jvm:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-json:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-graphite:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |         \--- com.thoughtworks.paranamer:paranamer:2.6     +--- org.apache.ivy:ivy:2.4.0     +--- oro:oro:2.0.8     +--- net.razorvine:pyrolite:4.13     +--- net.sf.py4j:py4j:0.10.4     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     +--- org.apache.commons:commons-crypto:1.0.0     \--- org.spark-project.spark:unused:1.0.0compileClasspath - Compile classpath for source set 'main'.\--- org.apache.spark:spark-core_2.11:2.1.0     +--- org.apache.avro:avro-mapred:1.7.7     |    +--- org.apache.avro:avro-ipc:1.7.7     |    |    +--- org.apache.avro:avro:1.7.7     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6     |    |    |    +--- org.apache.commons:commons-compress:1.4.1     |    |    |    |    \--- org.tukaani:xz:1.0     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     +--- com.twitter:chill_2.11:0.8.0     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- com.twitter:chill-java:0.8.0     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3     |    |         +--- com.esotericsoftware:minlog:1.3.0     |    |         \--- org.objenesis:objenesis:2.1     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)     +--- com.twitter:chill-java:0.8.0 (*)     +--- org.apache.xbean:xbean-asm5-shaded:4.4     +--- org.apache.hadoop:hadoop-client:2.2.0     |    +--- org.apache.hadoop:hadoop-common:2.2.0     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- org.apache.commons:commons-math:2.1     |    |    +--- xmlenc:xmlenc:0.52     |    |    +--- commons-httpclient:commons-httpclient:3.1     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-net:commons-net:3.1     |    |    +--- log4j:log4j:1.2.17     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- commons-configuration:commons-configuration:1.6     |    |    |    +--- commons-collections:commons-collections:3.2.1     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5     |    |    |    +--- commons-digester:commons-digester:1.8     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-api:1.7.16     |    |    |    \--- log4j:log4j:1.2.17     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    +--- commons-codec:commons-codec:1.4     |    |    |    +--- log4j:log4j:1.2.17     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17     |    |    |    \--- jline:jline:0.9.94     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- log4j:log4j:1.2.17     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    \--- xmlenc:xmlenc:0.52     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0     |    |    |    |    +--- log4j:log4j:1.2.17     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    |    \--- com.google.inject:guice:3.0     |    |    |    |    |         +--- javax.inject:javax.inject:1     |    |    |    |    |         +--- aopalliance:aopalliance:1.0     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0     +--- org.apache.spark:spark-launcher_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0     |    |    +--- org.scalatest:scalatest_2.11:2.2.6     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8     |    |    \--- org.spark-project.spark:unused:1.0.0     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-common_2.11:2.1.0     |    +--- io.netty:netty-all:4.0.42.Final     |    +--- org.apache.commons:commons-lang3:3.5     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)     |    +--- io.dropwizard.metrics:metrics-core:3.1.2     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-unsafe_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    +--- com.twitter:chill_2.11:0.8.0 (*)     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    \--- org.spark-project.spark:unused:1.0.0     +--- net.java.dev.jets3t:jets3t:0.7.1     |    +--- commons-codec:commons-codec:1.3 -> 1.4     |    \--- commons-httpclient:commons-httpclient:3.1 (*)     +--- org.apache.curator:curator-recipes:2.4.0     |    +--- org.apache.curator:curator-framework:2.4.0     |    |    +--- org.apache.curator:curator-client:2.4.0     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    \--- com.google.guava:guava:14.0.1     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    \--- com.google.guava:guava:14.0.1     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    \--- com.google.guava:guava:14.0.1     +--- javax.servlet:javax.servlet-api:3.1.0     +--- org.apache.commons:commons-lang3:3.5     +--- org.apache.commons:commons-math3:3.4.1     +--- com.google.code.findbugs:jsr305:1.3.9     +--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jul-to-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jcl-over-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- log4j:log4j:1.2.17     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)     +--- com.ning:compress-lzf:1.0.3     +--- org.xerial.snappy:snappy-java:1.1.2.6     +--- net.jpountz.lz4:lz4:1.3.0     +--- org.roaringbitmap:RoaringBitmap:0.5.11     +--- commons-net:commons-net:2.2 -> 3.1     +--- org.scala-lang:scala-library:2.11.8     +--- org.json4s:json4s-jackson_2.11:3.2.11     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    +--- org.json4s:json4s-core_2.11:3.2.11     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6     |    |    \--- org.scala-lang:scalap:2.11.0     |    |         \--- org.scala-lang:scala-compiler:2.11.0     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)     +--- org.glassfish.jersey.core:jersey-client:2.22.2     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    |    +--- javax.annotation:javax.annotation-api:1.2     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34     |    |    |    +--- javax.inject:javax.inject:1     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34     |    |    |    |    \--- javax.inject:javax.inject:1     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)     |    |    |    \--- org.javassist:javassist:3.18.1-GA     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     +--- org.glassfish.jersey.core:jersey-server:2.22.2     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- javax.annotation:javax.annotation-api:1.2     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    \--- javax.validation:validation-api:1.1.0.Final     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)     +--- io.netty:netty-all:4.0.42.Final     +--- io.netty:netty:3.8.0.Final     +--- com.clearspring.analytics:stream:2.7.0     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     +--- io.dropwizard.metrics:metrics-jvm:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-json:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-graphite:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |         \--- com.thoughtworks.paranamer:paranamer:2.6     +--- org.apache.ivy:ivy:2.4.0     +--- oro:oro:2.0.8     +--- net.razorvine:pyrolite:4.13     +--- net.sf.py4j:py4j:0.10.4     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     +--- org.apache.commons:commons-crypto:1.0.0     \--- org.spark-project.spark:unused:1.0.0compileOnly - Compile only dependencies for source set 'main'.No dependenciesdefault - Configuration for default artifacts.\--- org.apache.spark:spark-core_2.11:2.1.0     +--- org.apache.avro:avro-mapred:1.7.7     |    +--- org.apache.avro:avro-ipc:1.7.7     |    |    +--- org.apache.avro:avro:1.7.7     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6     |    |    |    +--- org.apache.commons:commons-compress:1.4.1     |    |    |    |    \--- org.tukaani:xz:1.0     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     +--- com.twitter:chill_2.11:0.8.0     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- com.twitter:chill-java:0.8.0     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3     |    |         +--- com.esotericsoftware:minlog:1.3.0     |    |         \--- org.objenesis:objenesis:2.1     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)     +--- com.twitter:chill-java:0.8.0 (*)     +--- org.apache.xbean:xbean-asm5-shaded:4.4     +--- org.apache.hadoop:hadoop-client:2.2.0     |    +--- org.apache.hadoop:hadoop-common:2.2.0     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- org.apache.commons:commons-math:2.1     |    |    +--- xmlenc:xmlenc:0.52     |    |    +--- commons-httpclient:commons-httpclient:3.1     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-net:commons-net:3.1     |    |    +--- log4j:log4j:1.2.17     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- commons-configuration:commons-configuration:1.6     |    |    |    +--- commons-collections:commons-collections:3.2.1     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5     |    |    |    +--- commons-digester:commons-digester:1.8     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-api:1.7.16     |    |    |    \--- log4j:log4j:1.2.17     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    +--- commons-codec:commons-codec:1.4     |    |    |    +--- log4j:log4j:1.2.17     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17     |    |    |    \--- jline:jline:0.9.94     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- log4j:log4j:1.2.17     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    \--- xmlenc:xmlenc:0.52     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0     |    |    |    |    +--- log4j:log4j:1.2.17     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    |    \--- com.google.inject:guice:3.0     |    |    |    |    |         +--- javax.inject:javax.inject:1     |    |    |    |    |         +--- aopalliance:aopalliance:1.0     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0     +--- org.apache.spark:spark-launcher_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0     |    |    +--- org.scalatest:scalatest_2.11:2.2.6     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8     |    |    \--- org.spark-project.spark:unused:1.0.0     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-common_2.11:2.1.0     |    +--- io.netty:netty-all:4.0.42.Final     |    +--- org.apache.commons:commons-lang3:3.5     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)     |    +--- io.dropwizard.metrics:metrics-core:3.1.2     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-unsafe_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    +--- com.twitter:chill_2.11:0.8.0 (*)     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    \--- org.spark-project.spark:unused:1.0.0     +--- net.java.dev.jets3t:jets3t:0.7.1     |    +--- commons-codec:commons-codec:1.3 -> 1.4     |    \--- commons-httpclient:commons-httpclient:3.1 (*)     +--- org.apache.curator:curator-recipes:2.4.0     |    +--- org.apache.curator:curator-framework:2.4.0     |    |    +--- org.apache.curator:curator-client:2.4.0     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    \--- com.google.guava:guava:14.0.1     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    \--- com.google.guava:guava:14.0.1     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    \--- com.google.guava:guava:14.0.1     +--- javax.servlet:javax.servlet-api:3.1.0     +--- org.apache.commons:commons-lang3:3.5     +--- org.apache.commons:commons-math3:3.4.1     +--- com.google.code.findbugs:jsr305:1.3.9     +--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jul-to-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jcl-over-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- log4j:log4j:1.2.17     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)     +--- com.ning:compress-lzf:1.0.3     +--- org.xerial.snappy:snappy-java:1.1.2.6     +--- net.jpountz.lz4:lz4:1.3.0     +--- org.roaringbitmap:RoaringBitmap:0.5.11     +--- commons-net:commons-net:2.2 -> 3.1     +--- org.scala-lang:scala-library:2.11.8     +--- org.json4s:json4s-jackson_2.11:3.2.11     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    +--- org.json4s:json4s-core_2.11:3.2.11     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6     |    |    \--- org.scala-lang:scalap:2.11.0     |    |         \--- org.scala-lang:scala-compiler:2.11.0     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)     +--- org.glassfish.jersey.core:jersey-client:2.22.2     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    |    +--- javax.annotation:javax.annotation-api:1.2     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34     |    |    |    +--- javax.inject:javax.inject:1     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34     |    |    |    |    \--- javax.inject:javax.inject:1     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)     |    |    |    \--- org.javassist:javassist:3.18.1-GA     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     +--- org.glassfish.jersey.core:jersey-server:2.22.2     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- javax.annotation:javax.annotation-api:1.2     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    \--- javax.validation:validation-api:1.1.0.Final     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)     +--- io.netty:netty-all:4.0.42.Final     +--- io.netty:netty:3.8.0.Final     +--- com.clearspring.analytics:stream:2.7.0     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     +--- io.dropwizard.metrics:metrics-jvm:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-json:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-graphite:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |         \--- com.thoughtworks.paranamer:paranamer:2.6     +--- org.apache.ivy:ivy:2.4.0     +--- oro:oro:2.0.8     +--- net.razorvine:pyrolite:4.13     +--- net.sf.py4j:py4j:0.10.4     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     +--- org.apache.commons:commons-crypto:1.0.0     \--- org.spark-project.spark:unused:1.0.0implementation - Implementation only dependencies for source set 'main'. (n)No dependenciesruntime - Runtime dependencies for source set 'main' (deprecated, use 'runtimeOnly ' instead).\--- org.apache.spark:spark-core_2.11:2.1.0     +--- org.apache.avro:avro-mapred:1.7.7     |    +--- org.apache.avro:avro-ipc:1.7.7     |    |    +--- org.apache.avro:avro:1.7.7     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6     |    |    |    +--- org.apache.commons:commons-compress:1.4.1     |    |    |    |    \--- org.tukaani:xz:1.0     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     +--- com.twitter:chill_2.11:0.8.0     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- com.twitter:chill-java:0.8.0     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3     |    |         +--- com.esotericsoftware:minlog:1.3.0     |    |         \--- org.objenesis:objenesis:2.1     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)     +--- com.twitter:chill-java:0.8.0 (*)     +--- org.apache.xbean:xbean-asm5-shaded:4.4     +--- org.apache.hadoop:hadoop-client:2.2.0     |    +--- org.apache.hadoop:hadoop-common:2.2.0     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- org.apache.commons:commons-math:2.1     |    |    +--- xmlenc:xmlenc:0.52     |    |    +--- commons-httpclient:commons-httpclient:3.1     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-net:commons-net:3.1     |    |    +--- log4j:log4j:1.2.17     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- commons-configuration:commons-configuration:1.6     |    |    |    +--- commons-collections:commons-collections:3.2.1     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5     |    |    |    +--- commons-digester:commons-digester:1.8     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-api:1.7.16     |    |    |    \--- log4j:log4j:1.2.17     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    +--- commons-codec:commons-codec:1.4     |    |    |    +--- log4j:log4j:1.2.17     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17     |    |    |    \--- jline:jline:0.9.94     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- log4j:log4j:1.2.17     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    \--- xmlenc:xmlenc:0.52     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0     |    |    |    |    +--- log4j:log4j:1.2.17     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    |    \--- com.google.inject:guice:3.0     |    |    |    |    |         +--- javax.inject:javax.inject:1     |    |    |    |    |         +--- aopalliance:aopalliance:1.0     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0     +--- org.apache.spark:spark-launcher_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0     |    |    +--- org.scalatest:scalatest_2.11:2.2.6     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8     |    |    \--- org.spark-project.spark:unused:1.0.0     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-common_2.11:2.1.0     |    +--- io.netty:netty-all:4.0.42.Final     |    +--- org.apache.commons:commons-lang3:3.5     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)     |    +--- io.dropwizard.metrics:metrics-core:3.1.2     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-unsafe_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    +--- com.twitter:chill_2.11:0.8.0 (*)     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    \--- org.spark-project.spark:unused:1.0.0     +--- net.java.dev.jets3t:jets3t:0.7.1     |    +--- commons-codec:commons-codec:1.3 -> 1.4     |    \--- commons-httpclient:commons-httpclient:3.1 (*)     +--- org.apache.curator:curator-recipes:2.4.0     |    +--- org.apache.curator:curator-framework:2.4.0     |    |    +--- org.apache.curator:curator-client:2.4.0     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    \--- com.google.guava:guava:14.0.1     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    \--- com.google.guava:guava:14.0.1     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    \--- com.google.guava:guava:14.0.1     +--- javax.servlet:javax.servlet-api:3.1.0     +--- org.apache.commons:commons-lang3:3.5     +--- org.apache.commons:commons-math3:3.4.1     +--- com.google.code.findbugs:jsr305:1.3.9     +--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jul-to-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jcl-over-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- log4j:log4j:1.2.17     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)     +--- com.ning:compress-lzf:1.0.3     +--- org.xerial.snappy:snappy-java:1.1.2.6     +--- net.jpountz.lz4:lz4:1.3.0     +--- org.roaringbitmap:RoaringBitmap:0.5.11     +--- commons-net:commons-net:2.2 -> 3.1     +--- org.scala-lang:scala-library:2.11.8     +--- org.json4s:json4s-jackson_2.11:3.2.11     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    +--- org.json4s:json4s-core_2.11:3.2.11     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6     |    |    \--- org.scala-lang:scalap:2.11.0     |    |         \--- org.scala-lang:scala-compiler:2.11.0     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)     +--- org.glassfish.jersey.core:jersey-client:2.22.2     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    |    +--- javax.annotation:javax.annotation-api:1.2     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34     |    |    |    +--- javax.inject:javax.inject:1     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34     |    |    |    |    \--- javax.inject:javax.inject:1     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)     |    |    |    \--- org.javassist:javassist:3.18.1-GA     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     +--- org.glassfish.jersey.core:jersey-server:2.22.2     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- javax.annotation:javax.annotation-api:1.2     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    \--- javax.validation:validation-api:1.1.0.Final     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)     +--- io.netty:netty-all:4.0.42.Final     +--- io.netty:netty:3.8.0.Final     +--- com.clearspring.analytics:stream:2.7.0     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     +--- io.dropwizard.metrics:metrics-jvm:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-json:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-graphite:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |         \--- com.thoughtworks.paranamer:paranamer:2.6     +--- org.apache.ivy:ivy:2.4.0     +--- oro:oro:2.0.8     +--- net.razorvine:pyrolite:4.13     +--- net.sf.py4j:py4j:0.10.4     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     +--- org.apache.commons:commons-crypto:1.0.0     \--- org.spark-project.spark:unused:1.0.0runtimeClasspath - Runtime classpath of source set 'main'.\--- org.apache.spark:spark-core_2.11:2.1.0     +--- org.apache.avro:avro-mapred:1.7.7     |    +--- org.apache.avro:avro-ipc:1.7.7     |    |    +--- org.apache.avro:avro:1.7.7     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6     |    |    |    +--- org.apache.commons:commons-compress:1.4.1     |    |    |    |    \--- org.tukaani:xz:1.0     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     +--- com.twitter:chill_2.11:0.8.0     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- com.twitter:chill-java:0.8.0     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3     |    |         +--- com.esotericsoftware:minlog:1.3.0     |    |         \--- org.objenesis:objenesis:2.1     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)     +--- com.twitter:chill-java:0.8.0 (*)     +--- org.apache.xbean:xbean-asm5-shaded:4.4     +--- org.apache.hadoop:hadoop-client:2.2.0     |    +--- org.apache.hadoop:hadoop-common:2.2.0     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- org.apache.commons:commons-math:2.1     |    |    +--- xmlenc:xmlenc:0.52     |    |    +--- commons-httpclient:commons-httpclient:3.1     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-net:commons-net:3.1     |    |    +--- log4j:log4j:1.2.17     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- commons-configuration:commons-configuration:1.6     |    |    |    +--- commons-collections:commons-collections:3.2.1     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5     |    |    |    +--- commons-digester:commons-digester:1.8     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-api:1.7.16     |    |    |    \--- log4j:log4j:1.2.17     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    +--- commons-codec:commons-codec:1.4     |    |    |    +--- log4j:log4j:1.2.17     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17     |    |    |    \--- jline:jline:0.9.94     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26     |    |    +--- commons-cli:commons-cli:1.2     |    |    +--- commons-codec:commons-codec:1.4     |    |    +--- commons-io:commons-io:2.1     |    |    +--- commons-lang:commons-lang:2.5     |    |    +--- log4j:log4j:1.2.17     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13     |    |    \--- xmlenc:xmlenc:0.52     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0     |    |    |    |    +--- log4j:log4j:1.2.17     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    |    \--- com.google.inject:guice:3.0     |    |    |    |    |         +--- javax.inject:javax.inject:1     |    |    |    |    |         +--- aopalliance:aopalliance:1.0     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    |    +--- commons-io:commons-io:2.1     |    |    |    |    \--- com.google.inject:guice:3.0 (*)     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)     |    |    +--- com.google.protobuf:protobuf-java:2.5.0     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0     +--- org.apache.spark:spark-launcher_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0     |    |    +--- org.scalatest:scalatest_2.11:2.2.6     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8     |    |    \--- org.spark-project.spark:unused:1.0.0     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-common_2.11:2.1.0     |    +--- io.netty:netty-all:4.0.42.Final     |    +--- org.apache.commons:commons-lang3:3.5     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)     |    +--- io.dropwizard.metrics:metrics-core:3.1.2     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    \--- org.spark-project.spark:unused:1.0.0     +--- org.apache.spark:spark-unsafe_2.11:2.1.0     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     |    +--- com.twitter:chill_2.11:0.8.0 (*)     |    +--- com.google.code.findbugs:jsr305:1.3.9     |    \--- org.spark-project.spark:unused:1.0.0     +--- net.java.dev.jets3t:jets3t:0.7.1     |    +--- commons-codec:commons-codec:1.3 -> 1.4     |    \--- commons-httpclient:commons-httpclient:3.1 (*)     +--- org.apache.curator:curator-recipes:2.4.0     |    +--- org.apache.curator:curator-framework:2.4.0     |    |    +--- org.apache.curator:curator-client:2.4.0     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    |    \--- com.google.guava:guava:14.0.1     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    |    \--- com.google.guava:guava:14.0.1     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)     |    \--- com.google.guava:guava:14.0.1     +--- javax.servlet:javax.servlet-api:3.1.0     +--- org.apache.commons:commons-lang3:3.5     +--- org.apache.commons:commons-math3:3.4.1     +--- com.google.code.findbugs:jsr305:1.3.9     +--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jul-to-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- org.slf4j:jcl-over-slf4j:1.7.16     |    \--- org.slf4j:slf4j-api:1.7.16     +--- log4j:log4j:1.2.17     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)     +--- com.ning:compress-lzf:1.0.3     +--- org.xerial.snappy:snappy-java:1.1.2.6     +--- net.jpountz.lz4:lz4:1.3.0     +--- org.roaringbitmap:RoaringBitmap:0.5.11     +--- commons-net:commons-net:2.2 -> 3.1     +--- org.scala-lang:scala-library:2.11.8     +--- org.json4s:json4s-jackson_2.11:3.2.11     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    +--- org.json4s:json4s-core_2.11:3.2.11     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6     |    |    \--- org.scala-lang:scalap:2.11.0     |    |         \--- org.scala-lang:scala-compiler:2.11.0     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)     +--- org.glassfish.jersey.core:jersey-client:2.22.2     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    |    +--- javax.annotation:javax.annotation-api:1.2     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34     |    |    |    +--- javax.inject:javax.inject:1     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34     |    |    |    |    \--- javax.inject:javax.inject:1     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)     |    |    |    \--- org.javassist:javassist:3.18.1-GA     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     +--- org.glassfish.jersey.core:jersey-server:2.22.2     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1     |    +--- javax.annotation:javax.annotation-api:1.2     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)     |    \--- javax.validation:validation-api:1.1.0.Final     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)     +--- io.netty:netty-all:4.0.42.Final     +--- io.netty:netty:3.8.0.Final     +--- com.clearspring.analytics:stream:2.7.0     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     +--- io.dropwizard.metrics:metrics-jvm:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-json:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- io.dropwizard.metrics:metrics-graphite:3.1.2     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)     |         \--- com.thoughtworks.paranamer:paranamer:2.6     +--- org.apache.ivy:ivy:2.4.0     +--- oro:oro:2.0.8     +--- net.razorvine:pyrolite:4.13     +--- net.sf.py4j:py4j:0.10.4     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)     +--- org.apache.commons:commons-crypto:1.0.0     \--- org.spark-project.spark:unused:1.0.0runtimeElements - Elements of runtime for main. (n)No dependenciesruntimeOnly - Runtime only dependencies for source set 'main'. (n)No dependenciestestCompile - Dependencies for source set 'test' (deprecated, use 'testImplementation ' instead).+--- org.apache.spark:spark-core_2.11:2.1.0|    +--- org.apache.avro:avro-mapred:1.7.7|    |    +--- org.apache.avro:avro-ipc:1.7.7|    |    |    +--- org.apache.avro:avro:1.7.7|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1|    |    |    |    |    \--- org.tukaani:xz:1.0|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    +--- com.twitter:chill_2.11:0.8.0|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- com.twitter:chill-java:0.8.0|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3|    |    |         +--- com.esotericsoftware:minlog:1.3.0|    |    |         \--- org.objenesis:objenesis:2.1|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)|    +--- com.twitter:chill-java:0.8.0 (*)|    +--- org.apache.xbean:xbean-asm5-shaded:4.4|    +--- org.apache.hadoop:hadoop-client:2.2.0|    |    +--- org.apache.hadoop:hadoop-common:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- org.apache.commons:commons-math:2.1|    |    |    +--- xmlenc:xmlenc:0.52|    |    |    +--- commons-httpclient:commons-httpclient:3.1|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-net:commons-net:3.1|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- commons-configuration:commons-configuration:1.6|    |    |    |    +--- commons-collections:commons-collections:3.2.1|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5|    |    |    |    +--- commons-digester:commons-digester:1.8|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16|    |    |    |    \--- log4j:log4j:1.2.17|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    +--- commons-codec:commons-codec:1.4|    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17|    |    |    |    \--- jline:jline:0.9.94|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    \--- xmlenc:xmlenc:0.52|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0|    |    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    |    \--- com.google.inject:guice:3.0|    |    |    |    |    |         +--- javax.inject:javax.inject:1|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0|    +--- org.apache.spark:spark-launcher_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8|    |    |    \--- org.spark-project.spark:unused:1.0.0|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-common_2.11:2.1.0|    |    +--- io.netty:netty-all:4.0.42.Final|    |    +--- org.apache.commons:commons-lang3:3.5|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    +--- com.twitter:chill_2.11:0.8.0 (*)|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- net.java.dev.jets3t:jets3t:0.7.1|    |    +--- commons-codec:commons-codec:1.3 -> 1.4|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)|    +--- org.apache.curator:curator-recipes:2.4.0|    |    +--- org.apache.curator:curator-framework:2.4.0|    |    |    +--- org.apache.curator:curator-client:2.4.0|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    \--- com.google.guava:guava:14.0.1|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    \--- com.google.guava:guava:14.0.1|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    \--- com.google.guava:guava:14.0.1|    +--- javax.servlet:javax.servlet-api:3.1.0|    +--- org.apache.commons:commons-lang3:3.5|    +--- org.apache.commons:commons-math3:3.4.1|    +--- com.google.code.findbugs:jsr305:1.3.9|    +--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jul-to-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jcl-over-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- log4j:log4j:1.2.17|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)|    +--- com.ning:compress-lzf:1.0.3|    +--- org.xerial.snappy:snappy-java:1.1.2.6|    +--- net.jpountz.lz4:lz4:1.3.0|    +--- org.roaringbitmap:RoaringBitmap:0.5.11|    +--- commons-net:commons-net:2.2 -> 3.1|    +--- org.scala-lang:scala-library:2.11.8|    +--- org.json4s:json4s-jackson_2.11:3.2.11|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    +--- org.json4s:json4s-core_2.11:3.2.11|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6|    |    |    \--- org.scala-lang:scalap:2.11.0|    |    |         \--- org.scala-lang:scala-compiler:2.11.0|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)|    +--- org.glassfish.jersey.core:jersey-client:2.22.2|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    |    +--- javax.annotation:javax.annotation-api:1.2|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34|    |    |    |    +--- javax.inject:javax.inject:1|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34|    |    |    |    |    \--- javax.inject:javax.inject:1|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)|    |    |    |    \--- org.javassist:javassist:3.18.1-GA|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    +--- org.glassfish.jersey.core:jersey-server:2.22.2|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- javax.annotation:javax.annotation-api:1.2|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    \--- javax.validation:validation-api:1.1.0.Final|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)|    +--- io.netty:netty-all:4.0.42.Final|    +--- io.netty:netty:3.8.0.Final|    +--- com.clearspring.analytics:stream:2.7.0|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-json:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |         \--- com.thoughtworks.paranamer:paranamer:2.6|    +--- org.apache.ivy:ivy:2.4.0|    +--- oro:oro:2.0.8|    +--- net.razorvine:pyrolite:4.13|    +--- net.sf.py4j:py4j:0.10.4|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    +--- org.apache.commons:commons-crypto:1.0.0|    \--- org.spark-project.spark:unused:1.0.0\--- junit:junit:4.11     \--- org.hamcrest:hamcrest-core:1.3testCompileClasspath - Compile classpath for source set 'test'.+--- org.apache.spark:spark-core_2.11:2.1.0|    +--- org.apache.avro:avro-mapred:1.7.7|    |    +--- org.apache.avro:avro-ipc:1.7.7|    |    |    +--- org.apache.avro:avro:1.7.7|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1|    |    |    |    |    \--- org.tukaani:xz:1.0|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    +--- com.twitter:chill_2.11:0.8.0|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- com.twitter:chill-java:0.8.0|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3|    |    |         +--- com.esotericsoftware:minlog:1.3.0|    |    |         \--- org.objenesis:objenesis:2.1|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)|    +--- com.twitter:chill-java:0.8.0 (*)|    +--- org.apache.xbean:xbean-asm5-shaded:4.4|    +--- org.apache.hadoop:hadoop-client:2.2.0|    |    +--- org.apache.hadoop:hadoop-common:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- org.apache.commons:commons-math:2.1|    |    |    +--- xmlenc:xmlenc:0.52|    |    |    +--- commons-httpclient:commons-httpclient:3.1|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-net:commons-net:3.1|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- commons-configuration:commons-configuration:1.6|    |    |    |    +--- commons-collections:commons-collections:3.2.1|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5|    |    |    |    +--- commons-digester:commons-digester:1.8|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16|    |    |    |    \--- log4j:log4j:1.2.17|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    +--- commons-codec:commons-codec:1.4|    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17|    |    |    |    \--- jline:jline:0.9.94|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    \--- xmlenc:xmlenc:0.52|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0|    |    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    |    \--- com.google.inject:guice:3.0|    |    |    |    |    |         +--- javax.inject:javax.inject:1|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0|    +--- org.apache.spark:spark-launcher_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8|    |    |    \--- org.spark-project.spark:unused:1.0.0|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-common_2.11:2.1.0|    |    +--- io.netty:netty-all:4.0.42.Final|    |    +--- org.apache.commons:commons-lang3:3.5|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    +--- com.twitter:chill_2.11:0.8.0 (*)|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- net.java.dev.jets3t:jets3t:0.7.1|    |    +--- commons-codec:commons-codec:1.3 -> 1.4|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)|    +--- org.apache.curator:curator-recipes:2.4.0|    |    +--- org.apache.curator:curator-framework:2.4.0|    |    |    +--- org.apache.curator:curator-client:2.4.0|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    \--- com.google.guava:guava:14.0.1|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    \--- com.google.guava:guava:14.0.1|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    \--- com.google.guava:guava:14.0.1|    +--- javax.servlet:javax.servlet-api:3.1.0|    +--- org.apache.commons:commons-lang3:3.5|    +--- org.apache.commons:commons-math3:3.4.1|    +--- com.google.code.findbugs:jsr305:1.3.9|    +--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jul-to-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jcl-over-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- log4j:log4j:1.2.17|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)|    +--- com.ning:compress-lzf:1.0.3|    +--- org.xerial.snappy:snappy-java:1.1.2.6|    +--- net.jpountz.lz4:lz4:1.3.0|    +--- org.roaringbitmap:RoaringBitmap:0.5.11|    +--- commons-net:commons-net:2.2 -> 3.1|    +--- org.scala-lang:scala-library:2.11.8|    +--- org.json4s:json4s-jackson_2.11:3.2.11|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    +--- org.json4s:json4s-core_2.11:3.2.11|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6|    |    |    \--- org.scala-lang:scalap:2.11.0|    |    |         \--- org.scala-lang:scala-compiler:2.11.0|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)|    +--- org.glassfish.jersey.core:jersey-client:2.22.2|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    |    +--- javax.annotation:javax.annotation-api:1.2|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34|    |    |    |    +--- javax.inject:javax.inject:1|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34|    |    |    |    |    \--- javax.inject:javax.inject:1|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)|    |    |    |    \--- org.javassist:javassist:3.18.1-GA|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    +--- org.glassfish.jersey.core:jersey-server:2.22.2|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- javax.annotation:javax.annotation-api:1.2|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    \--- javax.validation:validation-api:1.1.0.Final|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)|    +--- io.netty:netty-all:4.0.42.Final|    +--- io.netty:netty:3.8.0.Final|    +--- com.clearspring.analytics:stream:2.7.0|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-json:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |         \--- com.thoughtworks.paranamer:paranamer:2.6|    +--- org.apache.ivy:ivy:2.4.0|    +--- oro:oro:2.0.8|    +--- net.razorvine:pyrolite:4.13|    +--- net.sf.py4j:py4j:0.10.4|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    +--- org.apache.commons:commons-crypto:1.0.0|    \--- org.spark-project.spark:unused:1.0.0\--- junit:junit:4.11     \--- org.hamcrest:hamcrest-core:1.3testCompileOnly - Compile only dependencies for source set 'test'.No dependenciestestImplementation - Implementation only dependencies for source set 'test'. (n)No dependenciestestRuntime - Runtime dependencies for source set 'test' (deprecated, use 'testRuntimeOnly ' instead).+--- org.apache.spark:spark-core_2.11:2.1.0|    +--- org.apache.avro:avro-mapred:1.7.7|    |    +--- org.apache.avro:avro-ipc:1.7.7|    |    |    +--- org.apache.avro:avro:1.7.7|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1|    |    |    |    |    \--- org.tukaani:xz:1.0|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    +--- com.twitter:chill_2.11:0.8.0|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- com.twitter:chill-java:0.8.0|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3|    |    |         +--- com.esotericsoftware:minlog:1.3.0|    |    |         \--- org.objenesis:objenesis:2.1|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)|    +--- com.twitter:chill-java:0.8.0 (*)|    +--- org.apache.xbean:xbean-asm5-shaded:4.4|    +--- org.apache.hadoop:hadoop-client:2.2.0|    |    +--- org.apache.hadoop:hadoop-common:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- org.apache.commons:commons-math:2.1|    |    |    +--- xmlenc:xmlenc:0.52|    |    |    +--- commons-httpclient:commons-httpclient:3.1|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-net:commons-net:3.1|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- commons-configuration:commons-configuration:1.6|    |    |    |    +--- commons-collections:commons-collections:3.2.1|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5|    |    |    |    +--- commons-digester:commons-digester:1.8|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16|    |    |    |    \--- log4j:log4j:1.2.17|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    +--- commons-codec:commons-codec:1.4|    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17|    |    |    |    \--- jline:jline:0.9.94|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    \--- xmlenc:xmlenc:0.52|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0|    |    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    |    \--- com.google.inject:guice:3.0|    |    |    |    |    |         +--- javax.inject:javax.inject:1|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0|    +--- org.apache.spark:spark-launcher_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8|    |    |    \--- org.spark-project.spark:unused:1.0.0|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-common_2.11:2.1.0|    |    +--- io.netty:netty-all:4.0.42.Final|    |    +--- org.apache.commons:commons-lang3:3.5|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    +--- com.twitter:chill_2.11:0.8.0 (*)|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- net.java.dev.jets3t:jets3t:0.7.1|    |    +--- commons-codec:commons-codec:1.3 -> 1.4|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)|    +--- org.apache.curator:curator-recipes:2.4.0|    |    +--- org.apache.curator:curator-framework:2.4.0|    |    |    +--- org.apache.curator:curator-client:2.4.0|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    \--- com.google.guava:guava:14.0.1|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    \--- com.google.guava:guava:14.0.1|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    \--- com.google.guava:guava:14.0.1|    +--- javax.servlet:javax.servlet-api:3.1.0|    +--- org.apache.commons:commons-lang3:3.5|    +--- org.apache.commons:commons-math3:3.4.1|    +--- com.google.code.findbugs:jsr305:1.3.9|    +--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jul-to-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jcl-over-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- log4j:log4j:1.2.17|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)|    +--- com.ning:compress-lzf:1.0.3|    +--- org.xerial.snappy:snappy-java:1.1.2.6|    +--- net.jpountz.lz4:lz4:1.3.0|    +--- org.roaringbitmap:RoaringBitmap:0.5.11|    +--- commons-net:commons-net:2.2 -> 3.1|    +--- org.scala-lang:scala-library:2.11.8|    +--- org.json4s:json4s-jackson_2.11:3.2.11|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    +--- org.json4s:json4s-core_2.11:3.2.11|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6|    |    |    \--- org.scala-lang:scalap:2.11.0|    |    |         \--- org.scala-lang:scala-compiler:2.11.0|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)|    +--- org.glassfish.jersey.core:jersey-client:2.22.2|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    |    +--- javax.annotation:javax.annotation-api:1.2|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34|    |    |    |    +--- javax.inject:javax.inject:1|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34|    |    |    |    |    \--- javax.inject:javax.inject:1|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)|    |    |    |    \--- org.javassist:javassist:3.18.1-GA|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    +--- org.glassfish.jersey.core:jersey-server:2.22.2|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- javax.annotation:javax.annotation-api:1.2|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    \--- javax.validation:validation-api:1.1.0.Final|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)|    +--- io.netty:netty-all:4.0.42.Final|    +--- io.netty:netty:3.8.0.Final|    +--- com.clearspring.analytics:stream:2.7.0|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-json:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |         \--- com.thoughtworks.paranamer:paranamer:2.6|    +--- org.apache.ivy:ivy:2.4.0|    +--- oro:oro:2.0.8|    +--- net.razorvine:pyrolite:4.13|    +--- net.sf.py4j:py4j:0.10.4|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    +--- org.apache.commons:commons-crypto:1.0.0|    \--- org.spark-project.spark:unused:1.0.0\--- junit:junit:4.11     \--- org.hamcrest:hamcrest-core:1.3testRuntimeClasspath - Runtime classpath of source set 'test'.+--- org.apache.spark:spark-core_2.11:2.1.0|    +--- org.apache.avro:avro-mapred:1.7.7|    |    +--- org.apache.avro:avro-ipc:1.7.7|    |    |    +--- org.apache.avro:avro:1.7.7|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1|    |    |    |    |    \--- org.tukaani:xz:1.0|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    +--- com.twitter:chill_2.11:0.8.0|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- com.twitter:chill-java:0.8.0|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3|    |    |         +--- com.esotericsoftware:minlog:1.3.0|    |    |         \--- org.objenesis:objenesis:2.1|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)|    +--- com.twitter:chill-java:0.8.0 (*)|    +--- org.apache.xbean:xbean-asm5-shaded:4.4|    +--- org.apache.hadoop:hadoop-client:2.2.0|    |    +--- org.apache.hadoop:hadoop-common:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- org.apache.commons:commons-math:2.1|    |    |    +--- xmlenc:xmlenc:0.52|    |    |    +--- commons-httpclient:commons-httpclient:3.1|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-net:commons-net:3.1|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- commons-configuration:commons-configuration:1.6|    |    |    |    +--- commons-collections:commons-collections:3.2.1|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5|    |    |    |    +--- commons-digester:commons-digester:1.8|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16|    |    |    |    \--- log4j:log4j:1.2.17|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    +--- commons-codec:commons-codec:1.4|    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17|    |    |    |    \--- jline:jline:0.9.94|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26|    |    |    +--- commons-cli:commons-cli:1.2|    |    |    +--- commons-codec:commons-codec:1.4|    |    |    +--- commons-io:commons-io:2.1|    |    |    +--- commons-lang:commons-lang:2.5|    |    |    +--- log4j:log4j:1.2.17|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13|    |    |    \--- xmlenc:xmlenc:0.52|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0|    |    |    |    |    +--- log4j:log4j:1.2.17|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    |    \--- com.google.inject:guice:3.0|    |    |    |    |    |         +--- javax.inject:javax.inject:1|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    |    +--- commons-io:commons-io:2.1|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0|    +--- org.apache.spark:spark-launcher_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8|    |    |    \--- org.spark-project.spark:unused:1.0.0|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-common_2.11:2.1.0|    |    +--- io.netty:netty-all:4.0.42.Final|    |    +--- org.apache.commons:commons-lang3:3.5|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    |    +--- com.twitter:chill_2.11:0.8.0 (*)|    |    +--- com.google.code.findbugs:jsr305:1.3.9|    |    \--- org.spark-project.spark:unused:1.0.0|    +--- net.java.dev.jets3t:jets3t:0.7.1|    |    +--- commons-codec:commons-codec:1.3 -> 1.4|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)|    +--- org.apache.curator:curator-recipes:2.4.0|    |    +--- org.apache.curator:curator-framework:2.4.0|    |    |    +--- org.apache.curator:curator-client:2.4.0|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    |    \--- com.google.guava:guava:14.0.1|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    |    \--- com.google.guava:guava:14.0.1|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)|    |    \--- com.google.guava:guava:14.0.1|    +--- javax.servlet:javax.servlet-api:3.1.0|    +--- org.apache.commons:commons-lang3:3.5|    +--- org.apache.commons:commons-math3:3.4.1|    +--- com.google.code.findbugs:jsr305:1.3.9|    +--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jul-to-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- org.slf4j:jcl-over-slf4j:1.7.16|    |    \--- org.slf4j:slf4j-api:1.7.16|    +--- log4j:log4j:1.2.17|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)|    +--- com.ning:compress-lzf:1.0.3|    +--- org.xerial.snappy:snappy-java:1.1.2.6|    +--- net.jpountz.lz4:lz4:1.3.0|    +--- org.roaringbitmap:RoaringBitmap:0.5.11|    +--- commons-net:commons-net:2.2 -> 3.1|    +--- org.scala-lang:scala-library:2.11.8|    +--- org.json4s:json4s-jackson_2.11:3.2.11|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    +--- org.json4s:json4s-core_2.11:3.2.11|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6|    |    |    \--- org.scala-lang:scalap:2.11.0|    |    |         \--- org.scala-lang:scala-compiler:2.11.0|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)|    +--- org.glassfish.jersey.core:jersey-client:2.22.2|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    |    +--- javax.annotation:javax.annotation-api:1.2|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34|    |    |    |    +--- javax.inject:javax.inject:1|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34|    |    |    |    |    \--- javax.inject:javax.inject:1|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)|    |    |    |    \--- org.javassist:javassist:3.18.1-GA|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    +--- org.glassfish.jersey.core:jersey-server:2.22.2|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1|    |    +--- javax.annotation:javax.annotation-api:1.2|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)|    |    \--- javax.validation:validation-api:1.1.0.Final|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)|    +--- io.netty:netty-all:4.0.42.Final|    +--- io.netty:netty:3.8.0.Final|    +--- com.clearspring.analytics:stream:2.7.0|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-json:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)|    |         \--- com.thoughtworks.paranamer:paranamer:2.6|    +--- org.apache.ivy:ivy:2.4.0|    +--- oro:oro:2.0.8|    +--- net.razorvine:pyrolite:4.13|    +--- net.sf.py4j:py4j:0.10.4|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)|    +--- org.apache.commons:commons-crypto:1.0.0|    \--- org.spark-project.spark:unused:1.0.0\--- junit:junit:4.11     \--- org.hamcrest:hamcrest-core:1.3testRuntimeOnly - Runtime only dependencies for source set 'test'. (n)No dependencies(*) - dependencies omitted (listed previously)BUILD SUCCESSFULTotal time: 3.358 secs

11，编写Gradle脚本：

Gradle是以Groovy语言为基础，基于DSL语法的自动化构建工具，一个构建脚本能够包含任何Groovy语言元素，每个脚本都是UTF-8编码的文件。

Project对象API

println nameprintln project.nameprintln project.pathprintln project.projectDir

在idea中运行

BeiJing This is executed during the initialization phase.SparkUseGradleSparkUseGradle:G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017

Project对象提供了一些标准的属性，我们可以在构建脚本中很方便的使用他们，如下：

NameTypeDefault ValueprojectProjectProject实例对象nameString项目目录的名称pathString项目的绝对路径descriptionString项目描述projectDirFile包含构建脚本的目录buildFileprojectDir/buildgroupObject未具体说明versionObject未具体说明antAntBuilderAnt实例对象

 给出Project的apply方法的一个例子，这里自己循环加载，不断循环，StackOverflowError了，如下：

println rootProject.getRootDir().getAbsolutePath()apply from: rootProject.getRootDir().getAbsolutePath() + "/common.gradle"

在idea中运行如下：

BeiJing This is executed during the initialization phase.SparkUseGradleSparkUseGradle::...G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017FAILURE: Build failed with an exception.BUILD FAILED* Where:Total time: 6.36 secsScript 'G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\common.gradle' line: 21* What went wrong:A problem occurred evaluating script.> java.lang.StackOverflowError (no error message)

 Gradle对象API 

println "test :  " + gradle.gradleVersionprintln "test :  " + gradle.gradleHomeDir

在idea中运行

test :  3.5test :  E:\Program Files\gradle-3.5-all\gradle-3.5

 Gradle变量声明

在Gradle脚本中有两种类型的变量可以声明，如下：
局部变量
扩展变量

def dest = "dest"task copy(type: Copy) {    from "source"    into dest}

在idea中运行

:copy NO-SOURCE

在Gradle中所有被增强的对象可以拥有自定义属性（譬如projects、tasks、source sets等），使用ext扩展块可以一次添加多个属性。如下：

ext {    sparkVersion = "spark 1.6.0 Version"}sourceSets.all { ext.purpose = null }sourceSets {    main {        purpose = "production"    }    test {        purpose = "test"    }    plugin {        purpose = "production"    }}task printProperties << {    println sparkVersion    sourceSets.matching { it.purpose == "production" }.each { println it.name}} 

在idea中运行

:printPropertiesspark 1.6.0 VersionmainpluginBUILD SUCCESSFULTotal time: 4.832 secs

12，Gradle文件操作基础 

Project.file()方法来定位一个文件获取File对象

//相对路径File configFile = file('src/config.xml')//绝对路径println " configFile.absolutePath:  " + configFile.absolutePathFile configFile1 = file(configFile.absolutePath)//项目路径的文件对象File configFile2 = file(new File('src/config.xml'))

在idea中运行

configFile.absolutePath:  G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\config.xml

文件集合： Gradle使用FileCollection接口表示文件集合 

FileCollection collection = files('src/file1.txt',        new File('src/file2.txt'),        ['src/file3.txt', 'src/file4.txt'])// 对文件集合进行迭代collection.each {File file ->    println file.name}// 转换文件集合为其他类型Set set = collection.filesSet set2 = collection as SetList list = collection as ListString path = collection.asPath//File file = collection.singleFile//File file2 = collection as File// 增加和减少文件集合def union = collection + files('src/file3.txt')def different = collection - files('src/file3.txt')println unionprintln different

在idea中运行结果如下

file1.txtfile2.txtfile3.txtfile4.txtfile collectionfile collection

向files()方法传递闭包或者可回调的实例参数

task list << {    File srcDir    // 使用闭合创建一个文件集合    collection = files { srcDir.listFiles() }    srcDir = file('src')    println "Contents of $srcDir.name"    collection.collect { relativePath(it) }.sort().each { println it }    srcDir = file('src2')    println "Contents of $srcDir.name"    collection.collect { relativePath(it) }.sort().each { println it }}

在idea中运行

:listContents of srcContents of src2

之前的工程这里没有src，src2目录，因此打印不出详细目录。我们先建立一个目录，使用以下配置

apply plugin: 'idea'apply plugin: 'java'apply plugin: 'scala'sourceSets {    main {        scala {            srcDirs = ['src/main/scala', 'src/main/java']            srcDirs = ['src2/main/scalaIMF', 'src2/main/javaIMF']        }        java {            srcDirs = []        }    }    task "createProject" {        sourceSets*.scala.srcDirs*.each { it.mkdirs() }        sourceSets*.java.srcDirs*.each { it.mkdirs() }        sourceSets*.resources.srcDirs*.each { it.mkdirs() }    }    jar {        zip64 true        from { configurations.compile.collect { it.isDirectory() ? it : zipTree(it) } }        exclude 'META-INF/*.RSA', 'META-INF/*.SF', 'META-INF/*.DSA'        manifest {            attributes "Main-Class": "com.test.myClass"        }    }}

运行的结果如下，自动创建了src src2目录

在idea中运行结果

:list2Contents of srcsrc\mainsrc\testContents of src2src2\mainBUILD SUCCESSFULTotal time: 2.594 secs

文件树：文件树可以代表一个目录树结构或一个ZIP压缩文件的内容

//以一个基准目录创建一个文件树FileTree tree = fileTree(dir: 'src/main')// 添加包含和排除规则tree.include '**/*.java'tree.exclude '**/Abstract*'// 使用路径创建一个树tree = fileTree('src').include('**/*.java')// 使用闭合创建一个数tree = fileTree('src') {    include '**/*.java'}// 使用map创建一个树tree = fileTree(dir: 'src', include: '**/*.java')tree = fileTree(dir: 'src', includes: ['**/*.java', '**/*.xml'])tree = fileTree(dir: 'src', include: '**/*.java', exclude: '**/*test*/**')// 遍历文件树tree.each {File file ->    println "tree.each File file:   "  + file}// 过滤文件树FileTree filtered = tree.matching {    include 'org/gradle/api/**'}// 合并文件树AFileTree sum = tree + fileTree(dir: 'src/test')// 访问文件数的元素tree.visit {element ->    println  "tree.visit  element:    "   +  "$element.relativePath => $element.file"}

在idea中运行

tree.visit  element:    main => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\maintree.visit  element:    main/java => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\main\javatree.visit  element:    main/resources => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\main\resourcestree.visit  element:    main/scala => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\main\scala

 使用ZIP或TAR等压缩文件的内容作为文件树

// 使用路径创建一个ZIP文件FileTree zip = zipTree('someFile.zip')// 使用路径创建一个TAR文件FileTree tar = tarTree('someFile.tar')//TarTree可以根据文件扩展名得到压缩方式，如果我们想明确的指定压缩方式则可以如下操作FileTree someTar = tarTree(resources.gzip('someTar.ext'))

复制文件
 

task copyTask(type: Copy) {    from 'src/main/java'    into 'build/explodedWar'}task anotherCopyTask(type: Copy) {    //复制src/main/webapp目录下的所有文件    from 'src/main/webapp'    //复制一个单独文件    from 'src/staging/index.html'    //复制一个任务输出的文件    from copyTask    //显式使用任务的outputs属性复制任务的输出文件    //from copyTaskWithPatterns.outputs    //复制一个ZIP压缩文件的内容    from zipTree('src/main/assets.zip')    //指定目标目录    into { getDestDir() }}task copyTaskWithPatterns(type: Copy) {    from 'src/main/webapp'    into 'build/explodedWar'    include '**/*.html'    include '**/*.jsp'    exclude { details -> details.file.name.endsWith('.html') &&            details.file.text.contains('staging') }}task copyMethod << {    copy {        from 'src/main/java'        into 'src2/main/java/test2'        include '**/*'    }}//在复制时重命名文件task rename(type: Copy) {    from 'src/main/webapp'    into 'build/explodedWar'    //使用闭包映射文件名    rename { String fileName ->        fileName.replace('-staging-', '')    }    // 使用正则表达式映射文件名    rename '(.+)-staging-(.+)', '$1$2'    rename(/(.+)-staging-(.+)/, '$1$2')}

运行结果

文件同步任务：

task libs(type: Sync) {    from configurations.runtime    into "$buildDir/libs"}

结果：

:libs NO-SOURCE

Gradle的Java插件构建实例

加入上面插件以后Gradle默认希望能在src/main/java路径下找到源代码，在 src/test/java路径下找到测试代码，任何src/main/resources路径的文件都会被包含在JAR文件里，任何src/test/resources路径的文件都会被加入到classpath中以运行测试代码，所有的输出文件将会被创建在构建目录里，JAR文件存放在 build/libs文件夹里。


加入Java插件后我们可以通过gradle tasks命令来列出项目的所有任务，这样就可以知道Java插件添加了哪些task。常用的task如下：


build task 
当运行gradle build命令时Gradle将会编译和测试你的代码，并且创建一个包含类和资源的JAR文件。


clean task 
当运行gradle clean命令时Gradle将会删除build生成的目录和所有生成的文件。


assemble task 
当运行gradle assemble命令时Gradle将会编译并打包代码，但是并不运行单元测试。


check task 
当运行gradle check命令时Gradle将会编译并测试你的代码，其他的插件会加入更多的检查步骤。

sourceCompatibility = 1.5repositories {    mavenCentral()}dependencies {    // https://mvnrepository.com/artifact/org.apache.spark/spark-core_2.11    compile group: 'org.apache.spark', name: 'spark-core_2.11', version: '2.1.0'    compile group: 'commons-collections', name: 'commons-collections', version: '3.2'    testCompile group: 'junit', name: 'junit', version: '4.11'}jar {    manifest {        attributes 'Implementation-Title': 'Gradle Quickstart', 'Implementation-Version': version    }}test {    systemProperties 'property': 'value'}//uploadArchives taskuploadArchives {    repositories {        flatDir {            dirs 'repos'        }    }}

博学之，审问之，慎思之，明辨之，笃行之。有弗学，思之弗得，弗措也；有弗辨，辨之弗明，弗措也；有弗行，行之弗笃，弗措也。人一能之，已百之；人十能之，已千之。果能此道矣，虽愚必明，虽柔必强。 

《礼记·中庸》十九章