spark启动少包,怎么添加包

来源:互联网 发布:手机淘宝怎么设置运费 编辑:程序博客网 时间:2024/04/28 17:00

spark在linux下启动报

classnofoundException

把对应的包添加到一下路径  {spark_home}/lib

然后在{spark_home}/conf下的spark-env。sh


添加对应的包路径

export SPARK_CLASSPATH=$SPARK_CLASSPATH:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/slf4j-api-1.7.21.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/hadoop-common-2.6.0-cdh5.7.0.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/log4j-1.2.17.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/slf4j-log4j12-1.7.21.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/commons-configuration-1.6.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/guava-19.0.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/hadoop-auth-2.6.0-cdh5.7.0.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/commons-collections-3.2.2.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/jersey-core-1.19.1.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/javax.ws.rs-api-2.0.1.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/jersey-servlet-1.19.1.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/jersey-server-1.19.1.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/jackson-annotations-2.6.6.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/jackson-core-2.6.6.jar:/usr/local/bigdata/spark-1.6.0-cdh5.7.0/lib/jackson-databind-2.6.6.jar


添加包的命令不要换行,不然会识别不到

0 0