HadoopSourceAnalyse --- Nodemanager Container request handler
来源:互联网 发布:骚男的辣条淘宝店网址 编辑:程序博客网 时间:2024/04/30 22:16
Overview
Container 是Hadoop中运行任务的地方,当Resourcemanager收到一任务请求后,会向nodemanager 请求一个Container 来运行ApplicationMaster, ApplicationMaster运行起来之后,会继续向Resourcemanager请求新的container来运行任务, 当container 完成任务之后,ApplicationMaster会释放相应的container, 当任务完成之后,ApplicationMaster会释放自己 运行的Container;
StartContainerRequest handle
图 2-1
图 2-2
ContainerManager 收到StartContainer Request 之后 ,先进行运行时环境检查,如果一切都没有问题,则会在本建立一个container 和 一个Application FSM, 并启动Applicateion FSM,
Start Applicationdispatcher.getEventHandler().handle( new ApplicationInitEvent(applicationID, container .getLaunchContext().getApplicationACLs()));
StopContainerRequest Handle
该 request的处理过程与Start类似,仅向container发送killevent, 后续处理由containerFSM 完成,container 成功停止之后,会重新更新当前node的状态 信息:nodeStatusUPdater.sendOutOfBandHeartBeat();
- HadoopSourceAnalyse --- Nodemanager Container request handler
- HadoopSourceAnalyse --- Nodemanager Container FSM
- HadoopSourceAnalyse --- NodeManager -- initiate
- HadoopSourceAnalyse --- Nodemanager Application FSM
- HadoopSourceAnalyse---ResourceMananger-Request Handle
- Unauthorized request to start container
- Unauthorized request to start container.
- Data Import Request Handler
- SolrJ、Request Handler
- YARNMRv2 Node Manager深入剖析—NodeManager启动Container流程分析
- YARNMRv2 Node Manager深入剖析—NodeManager启动Container流程分析
- Yarn源代码分析之旅---NodeManager---Container管理之资源本地化
- nodemanager无法启动--Linux container executor not configured properly (error=24)
- YARNMRv2 Node Manager深入剖析—NodeManager启动Container流程分析
- Yarn异常Unauthorized request to start container
- Solr Request Handler, component, Filter
- HadoopSourceAnalyse---ResourceMananger-initiate
- HadoopSourceAnalyse---RMApp FSM
- 用canvas画外汇数据走势图.
- /Users/mac/Library/Developer/Xcode/DerivedData/YuQing-amkrrucjrnxwthbnkrzrrydcclei/
- CWnd 、CWindow 的区别
- 我原创一篇文章做测试
- 常用算法之回溯法
- HadoopSourceAnalyse --- Nodemanager Container request handler
- error MSB6006: "mt.exe" exited with code 31
- 让你的嵌入式应用全天候运行!
- HDU 3987 Harry Potter and the Forbidden Forest (求割边最少的最小割)
- GPFS文件系统分析
- linux进程控制
- 大数据:“人工特征工程+线性模型”的尽头
- python 文件目录操作
- hdfs基本操作,上传、下载、删除