Spark WARN cluster.ClusterScheduler: Initial job has not accepted any resources;check your cluster
来源:互联网 发布:炒股软件免费下载 编辑:程序博客网 时间:2024/05/16 16:07
在Spark集群模式执行以下命令时:
root@master:/home/hadoop/spark/bin# ./spark-shell –master spark://master:7077 –jars xxxxx –class xxx.xxxxx –driver-memory 3g –execute-memory 3g …
出现了这个错误: WARN cluster.ClusterScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory
可能是你在运行的时候hosts写错了. ”root@master :“说明主机的hostname是master,所以解决方法是用正确的host名(实在不行用ip)执行程序:
root@debian-master:/home/hadoop/spark/bin# ./run-example org.apache.spark.examples.SparkPi spark://debian-master:7077
其他解决方法:
检查你的drive-memory 和 executor-memory 是否超过了最大值,在spark_master_webui中可以看到节点的memory,如图:
0 0
- Spark WARN cluster.ClusterScheduler: Initial job has not accepted any resources;check your cluster
- Spark WARN cluster.ClusterScheduler: Initial job has not accepted any resources;check your cluster
- WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure
- WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster uito ensure
- spark WARNTaskSchedulerImpl:Initial job has not accepted any resources; check your cluster UI to
- spark-summit 中出现Initial job has not accepted any resources; check your cluster UI to ensure that wor
- 运行spark问题:Initial job has not accepted any resources; check your cluster UI to ensure that workers a
- Initial job has not accepted any resources;check your cluster All masters are unresponsive! Giving u
- Initial job has not accepted any resources; check your cluster UI to ensure that workers are registe
- erImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are
- Spark错误:WARN TaskSchedulerImpl: Initial job has not accepted any resources;
- Spark执行样例报警告:WARN scheduler.TaskSchedulerImpl: Initial job has not accepted any resources
- spark on yarn,Initial job has not accepted any resources
- initial job has not accepted any resources
- spark-submit 报错 Initial job has not accepted any resources
- initial job has not accepted any resources的spark错误解决办法
- HiBench运行spark用例报Initial job has not accepted any resources错误
- spark-submit 报错 Initial job has not accepted any resources
- RecyclerView 添加头部和尾部布局
- 从零开始写一个发送h264的rtsp服务器(下)
- 局域网内ip冲突引起的怪异现象
- 新标准c++程序设计教程chapter2_2015.7.22
- Android侧滑效果1-学习记录
- Spark WARN cluster.ClusterScheduler: Initial job has not accepted any resources;check your cluster
- Android之同一个TextView设置不同样式的文字
- 青年歌手大奖赛_评委会打分 (一道比较简单的题目)
- 常用哈希函数的比较及其C语言实现
- 2015072203 - 要求别人的同时更得严格要求自己
- 如何给树莓派的无线网卡设置静态IP地址
- utf-8/gbk 的不可映射字符 打包后的效果:zip包 名称包含svn号
- 垂直翻页的Viewpager
- kafka(2)