如何在idea里面直接运行spark streaming程序
来源:互联网 发布:iframe 跨域调用js 编辑:程序博客网 时间:2024/06/14 22:25
在windows环境下,虽然控制台报了一大堆错误,但是spark streaming还是按照它的逻辑跑着,也能得到正确的结果,并且能够打断点调试!!!
由于报了一大坨的错误在控制台,导致我想看到的信息老是被刷屏出去,于是把代码放进linux的idea中去跑,发现streaming程序根本启动不起来!报如下错误:
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties16/05/03 14:10:40 INFO SparkContext: Running Spark version 1.5.0-cdh5.5.116/05/03 14:10:40 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable16/05/03 14:10:42 INFO SecurityManager: Changing view acls to: root16/05/03 14:10:42 INFO SecurityManager: Changing modify acls to: root16/05/03 14:10:42 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); users with modify permissions: Set(root)16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 WARN Utils: Service 'sparkDriver' could not bind on port 0. Attempting port 1.16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 INFO Slf4jLogger: Slf4jLogger started16/05/03 14:10:42 INFO Remoting: Starting remoting16/05/03 14:10:42 ERROR Remoting: Remoting error: [Startup failed] [akka.remote.RemoteTransportException: Startup failedat akka.remote.Remoting.akka$remote$Remoting$$notifyError(Remoting.scala:129)at akka.remote.Remoting.start(Remoting.scala:194)at akka.remote.RemoteActorRefProvider.init(RemoteActorRefProvider.scala:184)at akka.actor.ActorSystemImpl._start$lzycompute(ActorSystem.scala:579)at akka.actor.ActorSystemImpl._start(ActorSystem.scala:577)at akka.actor.ActorSystemImpl.start(ActorSystem.scala:588)at akka.actor.ActorSystem$.apply(ActorSystem.scala:111)at akka.actor.ActorSystem$.apply(ActorSystem.scala:104)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.rpc.akka.AkkaRpcEnvFactory.create(AkkaRpcEnv.scala:253)at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:53)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:252)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)at org.apache.spark.SparkContext.<init>(SparkContext.scala:450)at org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:854)at org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)at com.kingnet.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:55)at com.kingnet.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:497)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: /180.168.41.175:0at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)Caused by: java.net.BindException: Cannot assign requested addressat sun.nio.ch.Net.bind0(Native Method)at sun.nio.ch.Net.bind(Net.java:433)at sun.nio.ch.Net.bind(Net.java:425)at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:366)at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:290)at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)]16/05/03 14:10:42 ERROR SparkContext: Error initializing SparkContext.java.net.BindException: Failed to bind to: /180.168.41.175:0: Service 'sparkDriver' failed after 16 retries!at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)16/05/03 14:10:42 INFO SparkContext: Successfully stopped SparkContextException in thread "main" java.net.BindException: Failed to bind to: /180.168.41.175:0: Service 'sparkDriver' failed after 16 retries!at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:391)at akka.remote.transport.netty.NettyTransport$$anonfun$listen$1.apply(NettyTransport.scala:388)at scala.util.Success$$anonfun$map$1.apply(Try.scala:206)at scala.util.Try$.apply(Try.scala:161)at scala.util.Success.map(Try.scala:206)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:235)at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:42)at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)16/05/03 14:10:42 INFO ShutdownHookManager: Shutdown hook called
大致看了一下日志,是无法启动sparkDriver,Failed to bind to: /180.168.41.175:0,发现这个IP根本不是我机器的IP啊,应该是公司办公网络对外的IP地址。
谷歌了一下,找到了解决方案,配置一下环境变量SPARK_LOCAL_IP=127.0.0.1 就OK了。
目前处理方式就是debug代码逻辑问题就在windows中。预发布测试就在linux中测试。
0 0
- 如何在idea里面直接运行spark streaming程序
- 如何优雅地终止正在运行的Spark Streaming程序
- 使用IntelliJ IDEA编写SparkPi直接在Spark中运行
- 使用IDEA运行Spark程序
- windows在IDEA环境运行spark程序(spark安装在另一台mac机器)
- Spark java API 单词计数 ----直接在本地IDEA中运行
- 如何在Xcode里面运行C语言程序---简单展示
- Spark Streaming 初运行
- intelliji idea 基于maven运行spark程序
- IntelliJ Idea开发spark程序及运行
- 使用idea sbt运行spark程序
- 如何在python下直接运行py程序
- 如何在python shell下直接运行py程序
- 长时间运行的spark-streaming程序自动退出的问题
- 在IDEA中调试运行Spark SQL
- Spark-Streaming 程序监控
- Spark组件之Spark Streaming学习6--如何调用Dstream里面的getOrCompute方法?
- Spark Streaming之运行原理
- Android Studio 小技巧合集
- 红黑树的经典讲解
- GDI 总结三: CImage类使用
- Html5 添加class 浏览器不支持问题
- node 图片加水印
- 如何在idea里面直接运行spark streaming程序
- SubVersion服务安装设置
- MongoDB删除数据库
- How do I keep my driver from running out of kernel-mode stack
- 计算机病毒常识
- spring(基础11) Spring AOP 实现原理
- 监听器
- MongoDB插入文档
- Java多线程编程1----基础知识--暂停线程(sleep(),yield(),join()详解)