Oozie bundle定时调度多job
来源:互联网 发布:软件语言培训学校 编辑:程序博客网 时间:2024/06/06 03:01
- 包含关系
- 实例
- workflow1xml
- workflow2xml
- coordinator1xml
- coordinator2xml
- bundlexml
- jobproperties
包含关系
几个包含关系:
action∈workflow∈coordinatorㄈbundle
就是workflow可以包含多可action,通过coordinator来定时调度workflow,通过bundle来绑定多个coordinator
实例
workflow1.xml
<workflow-app xmlns="uri:oozie:workflow:0.4" name="shell-wf"> <start to="shell-node"/> <action name="shell-node"> <shell xmlns="uri:oozie:shell-action:0.1"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <configuration> <property> <name>mapred.job.queue.name</name> <value>${queueName}</value> </property> </configuration> <exec>echo</exec> <argument>xx="=======111111...======="</argument> <capture-output/> </shell> <ok to="second"/> <error to="fail"/> </action> <action name="second"> <shell xmlns="uri:oozie:shell-action:0.1"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <configuration> <property> <name>mapred.job.queue.name</name> <value>${queueName}</value> </property> </configuration> <exec>echo</exec> <argument>xx="=======second...======="</argument> <capture-output/> </shell> <ok to="third"/> <error to="fail"/> </action> <action name="third"> <app-path>${workflowAppUri3}</app-path> </action> <kill name="fail"> <message>Shell action failed, error message</message> </kill> <end name="end"/></workflow-app>
workflow2.xml
<workflow-app xmlns="uri:oozie:workflow:0.4" name="shell-wf"> <start to="shell-node"/> <action name="shell-node"> <shell xmlns="uri:oozie:shell-action:0.1"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <configuration> <property> <name>mapred.job.queue.name</name> <value>${queueName}</value> </property> </configuration> <exec>echo</exec> <argument>xx="=======222222...======="</argument> <capture-output/> </shell> <ok to="end"/> <error to="fail"/> </action> <kill name="fail"> <message>Shell action failed, error message</message> </kill> <end name="end"/></workflow-app>
coordinator1.xml
<coordinator-app name="cron-coord1" frequency="${coord:minutes(5)}" start="${start}" end="${end}" timezone="UTC" xmlns="uri:oozie:coordinator:0.2"> <action> <workflow> <app-path>${workflowAppUri1}</app-path> <configuration> <property> <name>jobTracker</name> <value>${jobTracker}</value> </property> <property> <name>nameNode</name> <value>${nameNode}</value> </property> <property> <name>queueName</name> <value>${queueName}</value> </property> </configuration> </workflow> </action></coordinator-app>
coordinator2.xml
<coordinator-app name="cron-coord2" frequency="${coord:minutes(7)}" start="${start}" end="${end}" timezone="UTC" xmlns="uri:oozie:coordinator:0.2"> <action> <workflow> <app-path>${workflowAppUri2}</app-path> <configuration> <property> <name>jobTracker</name> <value>${jobTracker}</value> </property> <property> <name>nameNode</name> <value>${nameNode}</value> </property> <property> <name>queueName</name> <value>${queueName}</value> </property> </configuration> </workflow> </action></coordinator-app>
bundle.xml
<bundle-app name='bundle-app' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xmlns='uri:oozie:bundle:0.1'> <coordinator name='cron-coord1'> <app-path>${coordinator1}</app-path> </coordinator> <coordinator name='cron-coord2'> <app-path>${coordinator2}</app-path> </coordinator></bundle-app>
job.properties
nameNode=hdfs://nameservice1jobTracker=cm:8032queueName=defaultexamplesRoot=examplesoozie.libpath=${nameNode}/user/${user.name}/share/lib# 定时任务设置# 设置bundle路径oozie.bundle.application.path=${nameNode}/user/${user.name}/shell/bundle.xmlstart=2017-06-30T08:56Zend=2017-06-30T09:20Z# 定义workflow路径workflowAppUri2=${nameNode}/user/${user.name}/shell/workflow2.xmlworkflowAppUri1=${nameNode}/user/${user.name}/shell/workflow1.xml# 定义coordinatorcoordinator1=${nameNode}/user/${user.name}/shell/coordinator1.xmlcoordinator2=${nameNode}/user/${user.name}/shell/coordinator2.xml
阅读全文
0 0
- Oozie bundle定时调度多job
- CDH中oozie 定时调度sqoop job
- oozie 定时调度时区设置
- Oracle Job定时调度
- oracle job定时调度任务
- Oozie调度Pig job常见的问题及分析
- Spark job在hue-oozie中的另一种方式调度
- oozie定时调度的配置说明第一篇
- oozie定时调度的配置说明第二篇
- OOZIE系统成功【2】跑通定时调度的…
- 使用oozie实现spark定时调度和spark依赖
- Oracle定时调度(schedule和job结合)
- oozie的作业调度
- Oozie作业调度
- 工作流调度框架Oozie
- OOZIE JA017: Unknown hadoop job
- Oozie API调用Hue JOB
- [译]Java定时任务调度-Quartz文档(三)进一步讲讲Job和Job Detail
- pprint和print区别
- 家用路由器配置
- 用ps批量压缩图片
- 各种数学平均数之间的关系
- 分享一个自用小功能--微信公众号签到
- Oozie bundle定时调度多job
- Android音视频API(android.media.audiofx):概览
- CString和string的相互转换
- python datetime 以及如何用%s来调用
- linux系统配置序列号
- codeforces 814D An overnight dance in discotheque(贪心)
- 46 《未来的工作》 -豆瓣评分7.0
- Linux下修改tomcat JVM内存大小
- Scala入门到精通——第二十七节 Scala操纵XML