Airflow 初试

来源：互联网发布：外国在线视频下载软件编辑：程序博客网时间：2024/06/06 11:40

smtp 配置：

[smtp]# If you want airflow to send emails on retries, failure, and you want to use# the airflow.utils.email.send_email_smtp function, you have to configure an smtp# server heresmtp_host = smtp_starttls = Falsesmtp_ssl = Falsesmtp_user = smtp_port = smtp_password = smtp_mail_from =

一个DAG例子：test.py

from airflow.models import DAGfrom airflow.operators import BashOperatorfrom datetime import datetime, timedeltadefault_args = {    'owner': 'hadoop',             'depends_on_past': False,     'start_date': datetime(2017, 4, 27),    'email': ['***@163.com', ...],    'email_on_failure': True,    'email_on_retry': True,    #'queue':'celery', }dag = DAG(dag_id='dag1',         default_args=default_args,        schedule_interval='0 0 * * *'        )t1 = BashOperator(    task_id='task1',     bash_command="***",     dag=dag)t2 = BashOperator(    task_id='task2',     bash_command="***",     dag=dag)t3 = BashOperator(    task_id='task3',     bash_command="***",     dag=dag)t2.set_upstream(t1)t3.set_upstream(t2)

http://pythonhosted.org/airflow/
http://itfish.net/article/63888.html
http://ju.outofmemory.cn/entry/245373

阅读全文

0 0