Spark scheduler内核理解

来源:互联网 发布:云上贵州大数据秦晓东 编辑:程序博客网 时间:2024/05/17 23:32

RDD object
build operator GDA
DGA Scheduler
split graph into stages of tasks
submit each stage as ready
TaskScheduler
lunch tasks via cluster manager
Worker
execute tasks
store and servr block