spark-submit 报错 Initial job has not accepted any resources
来源：互联网 发布：c语言赋值表达式 编辑：程序博客网 时间：2024/06/05 14:32
spark-submit 报这样的错误
![]()
WARN scheduler.TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
错误原因是内存缺少资源
我的虚拟机内存只有1g，所以spark-env.sh配置
export SPARK_WORKER_MEMORY=800m但是在我执行spark-submit的时候没有加 --executor-memory参数，spark-submit默认提交任务的时候是1024m，如下图
就出现了上面的错误
解决办法是 spark-submit 后面加--executor-memory 512m就运行正常了
0 0
- spark-submit 报错 Initial job has not accepted any resources
- spark-submit 报错 Initial job has not accepted any resources
- spark on yarn，Initial job has not accepted any resources
- initial job has not accepted any resources
- Spark WARN cluster.ClusterScheduler: Initial job has not accepted any resources;check your cluster
- spark WARNTaskSchedulerImpl:Initial job has not accepted any resources; check your cluster UI to
- Spark错误：WARN TaskSchedulerImpl: Initial job has not accepted any resources;
- Spark WARN cluster.ClusterScheduler: Initial job has not accepted any resources;check your cluster
- Spark执行样例报警告：WARN scheduler.TaskSchedulerImpl: Initial job has not accepted any resources
- initial job has not accepted any resources的spark错误解决办法
- HiBench运行spark用例报Initial job has not accepted any resources错误
- spark-summit 中出现Initial job has not accepted any resources; check your cluster UI to ensure that wor
- 运行spark问题：Initial job has not accepted any resources; check your cluster UI to ensure that workers a
- WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure
- Initial job has not accepted any resources;check your cluster All masters are unresponsive! Giving u
- WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster uito ensure
- Initial job has not accepted any resources; check your cluster UI to ensure that workers are registe
- erImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are
- Android中应用程序如何获得系统签名权限
- java基础知识
- Sql日期时间格式转换
- android 传统蓝牙Bluetooth联通性
- C++和双重检查锁定模式(DCLP)的风险（转）
- spark-submit 报错 Initial job has not accepted any resources
- 8VC Venture Cup 2016 - Elimination Round E. Simple Skewness（枚举+三分）
- RxJava Android 新人实践
- BaseAdapter——convertView回收机制与动态控件响应
- redis设置访问密码
- 关于unity增强现实AR之高通AR（vufoia）的研究
- sparkR处理Gb级数据集
- 缓冲隔离方法论
- Usage of forceLayout(), requestLayout() and invalidate()
