The scheduler does not appear to be running. Last heartbeat was received .

The DAGs list may not update, and new tasks will not be scheduled.

Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-13T18:00:00+00:00 TriggerDagRunOperator 2021-06-13T19:10:15.641411+00:00 2021-06-13T19:10:16.142345+00:00 0:00:00.500934 40557 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T19:10:13.201272+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-13T18:05:00+00:00 EmrJobFlowSensor 2021-06-13T19:06:03.237506+00:00 2021-06-13T19:14:05.653449+00:00 0:08:02.415943 40556 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T19:06:00.855500+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-13T18:05:00+00:00 EmrCreateJobFlowOperator 2021-06-13T19:05:43.004255+00:00 2021-06-13T19:05:44.709026+00:00 0:00:01.704771 40555 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T19:05:40.721791+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-13T18:05:00+00:00 PythonOperator 2021-06-13T19:05:20.886426+00:00 2021-06-13T19:05:24.272301+00:00 0:00:03.385875 40554 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T19:05:18.707009+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-13T18:00:00+00:00 EmrJobFlowSensor 2021-06-13T19:01:04.496068+00:00 2021-06-13T19:12:07.203598+00:00 0:11:02.707530 40553 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T19:01:02.189372+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-13T18:00:00+00:00 EmrJobFlowSensor 2021-06-13T19:01:00.575694+00:00 2021-06-13T19:10:03.307654+00:00 0:09:02.731960 40552 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T19:00:58.265360+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-13T18:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T19:00:41.157784+00:00 2021-06-13T19:00:42.842544+00:00 0:00:01.684760 40551 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T19:00:38.174578+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-13T18:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T19:00:38.508038+00:00 2021-06-13T19:00:40.707638+00:00 0:00:02.199600 40550 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-13T19:00:36.165257+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-13T18:00:00+00:00 PythonOperator 2021-06-13T19:00:18.565401+00:00 2021-06-13T19:00:21.956315+00:00 0:00:03.390914 40549 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T19:00:16.157843+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-13T18:00:00+00:00 PythonOperator 2021-06-13T19:00:16.572551+00:00 2021-06-13T19:00:20.061361+00:00 0:00:03.488810 40548 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-13T19:00:14.173115+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-13T17:00:00+00:00 EmrJobFlowSensor 2021-06-13T18:12:21.120653+00:00 2021-06-13T18:20:23.684651+00:00 0:08:02.563998 40546 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T18:12:18.675752+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-13T17:00:00+00:00 EmrJobFlowSensor 2021-06-13T18:12:16.914751+00:00 2021-06-13T18:21:19.695902+00:00 0:09:02.781151 40545 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T18:12:14.662715+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-13T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T18:11:59.169325+00:00 2021-06-13T18:12:00.876409+00:00 0:00:01.707084 40544 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T18:11:56.583275+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-13T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T18:11:56.712383+00:00 2021-06-13T18:11:58.796453+00:00 0:00:02.084070 40543 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T18:11:54.564046+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-13T17:00:00+00:00 PythonOperator 2021-06-13T18:11:37.779037+00:00 2021-06-13T18:11:41.294938+00:00 0:00:03.515901 40542 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T18:11:34.548420+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-13T17:00:00+00:00 PythonOperator 2021-06-13T18:11:34.902517+00:00 2021-06-13T18:11:39.294530+00:00 0:00:04.392013 40541 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T18:11:32.547280+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-13T17:00:00+00:00 TriggerDagRunOperator 2021-06-13T18:11:28.986387+00:00 2021-06-13T18:11:29.507358+00:00 0:00:00.520971 40540 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T18:11:26.507199+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-13T17:00:00+00:00 TriggerDagRunOperator 2021-06-13T18:11:28.777661+00:00 2021-06-13T18:11:29.162636+00:00 0:00:00.384975 40539 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T18:11:26.507169+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-13T17:05:00+00:00 EmrJobFlowSensor 2021-06-13T18:06:04.144640+00:00 2021-06-13T18:15:06.732556+00:00 0:09:02.587916 40538 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T18:06:01.808653+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-13T17:05:00+00:00 EmrCreateJobFlowOperator 2021-06-13T18:05:40.117490+00:00 2021-06-13T18:05:41.747257+00:00 0:00:01.629767 40537 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T18:05:37.851223+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-13T17:05:00+00:00 PythonOperator 2021-06-13T18:05:20.126519+00:00 2021-06-13T18:05:23.508742+00:00 0:00:03.382223 40536 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T18:05:17.736742+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-13T17:00:00+00:00 EmrJobFlowSensor 2021-06-13T18:01:07.760123+00:00 2021-06-13T18:11:10.616915+00:00 0:10:02.856792 40535 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T18:01:05.288351+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-13T17:00:00+00:00 EmrJobFlowSensor 2021-06-13T18:01:03.463419+00:00 2021-06-13T18:14:06.500722+00:00 0:13:03.037303 40534 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T18:01:01.284807+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-13T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T18:00:45.393325+00:00 2021-06-13T18:00:47.062961+00:00 0:00:01.669636 40533 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-13T18:00:43.204003+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-13T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T18:00:41.296715+00:00 2021-06-13T18:00:42.986614+00:00 0:00:01.689899 40532 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T18:00:39.196405+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-13T17:00:00+00:00 PythonOperator 2021-06-13T18:00:23.568037+00:00 2021-06-13T18:00:26.995959+00:00 0:00:03.427922 40531 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-13T18:00:21.188459+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-13T17:00:00+00:00 PythonOperator 2021-06-13T18:00:17.807849+00:00 2021-06-13T18:00:21.238068+00:00 0:00:03.430219 40530 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T18:00:15.159993+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-13T16:00:00+00:00 EmrJobFlowSensor 2021-06-13T17:22:46.477906+00:00 2021-06-13T17:22:48.101209+00:00 0:00:01.623303 40528 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T17:22:44.228302+00:00 3 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-13T16:00:00+00:00 EmrJobFlowSensor 2021-06-13T17:11:19.465415+00:00 2021-06-13T17:21:22.230958+00:00 0:10:02.765543 40527 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T17:11:17.164103+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-13T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T17:10:57.526341+00:00 2021-06-13T17:10:59.276369+00:00 0:00:01.750028 40525 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T17:10:55.089062+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-13T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T17:10:57.421646+00:00 2021-06-13T17:10:59.113414+00:00 0:00:01.691768 40524 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T17:10:55.089012+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-13T16:00:00+00:00 PythonOperator 2021-06-13T17:10:35.706655+00:00 2021-06-13T17:10:38.943021+00:00 0:00:03.236366 40523 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T17:10:33.051466+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-13T16:00:00+00:00 PythonOperator 2021-06-13T17:10:35.511071+00:00 2021-06-13T17:10:39.169028+00:00 0:00:03.657957 40522 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T17:10:33.051435+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-13T16:00:00+00:00 TriggerDagRunOperator 2021-06-13T17:10:13.749732+00:00 2021-06-13T17:10:14.262855+00:00 0:00:00.513123 40521 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T17:10:11.070301+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-13T16:00:00+00:00 TriggerDagRunOperator 2021-06-13T17:10:13.568170+00:00 2021-06-13T17:10:13.980309+00:00 0:00:00.412139 40520 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T17:10:11.070351+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-13T16:05:00+00:00 EmrJobFlowSensor 2021-06-13T17:05:48.872693+00:00 2021-06-13T17:14:51.565753+00:00 0:09:02.693060 40519 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T17:05:46.537059+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-13T16:05:00+00:00 EmrCreateJobFlowOperator 2021-06-13T17:05:26.661654+00:00 2021-06-13T17:05:28.303887+00:00 0:00:01.642233 40518 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T17:05:24.507660+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-13T16:05:00+00:00 PythonOperator 2021-06-13T17:05:06.673680+00:00 2021-06-13T17:05:10.103022+00:00 0:00:03.429342 40517 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T17:05:04.486720+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-13T16:00:00+00:00 EmrJobFlowSensor 2021-06-13T17:01:06.215842+00:00 2021-06-13T17:10:08.903757+00:00 0:09:02.687915 40516 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T17:01:04.050533+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-13T16:00:00+00:00 EmrJobFlowSensor 2021-06-13T17:00:58.295767+00:00 2021-06-13T17:14:01.518734+00:00 0:13:03.222967 40515 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T17:00:56.036868+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-13T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T17:00:42.564475+00:00 2021-06-13T17:00:44.323566+00:00 0:00:01.759091 40514 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-13T17:00:40.063937+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-13T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T17:00:36.471377+00:00 2021-06-13T17:00:38.117364+00:00 0:00:01.645987 40513 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T17:00:34.145545+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-13T16:00:00+00:00 PythonOperator 2021-06-13T17:00:20.349820+00:00 2021-06-13T17:00:23.661719+00:00 0:00:03.311899 40512 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-13T17:00:18.007856+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-13T16:00:00+00:00 PythonOperator 2021-06-13T17:00:14.437671+00:00 2021-06-13T17:00:17.848431+00:00 0:00:03.410760 40511 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T17:00:12.001918+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-13T15:00:00+00:00 EmrJobFlowSensor 2021-06-13T16:12:11.439069+00:00 2021-06-13T16:21:14.021047+00:00 0:09:02.581978 40509 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T16:12:09.265931+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-13T15:00:00+00:00 EmrJobFlowSensor 2021-06-13T16:11:53.504371+00:00 2021-06-13T16:20:56.273531+00:00 0:09:02.769160 40508 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T16:11:51.248575+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-13T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T16:11:39.471401+00:00 2021-06-13T16:11:41.147741+00:00 0:00:01.676340 40507 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T16:11:37.263019+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-13T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T16:11:27.457508+00:00 2021-06-13T16:11:29.300696+00:00 0:00:01.843188 40506 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T16:11:25.208030+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-13T15:00:00+00:00 PythonOperator 2021-06-13T16:11:15.623324+00:00 2021-06-13T16:11:18.857535+00:00 0:00:03.234211 40505 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T16:11:13.262747+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-13T15:00:00+00:00 PythonOperator 2021-06-13T16:11:05.576552+00:00 2021-06-13T16:11:09.276402+00:00 0:00:03.699850 40504 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T16:11:03.196737+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-13T15:00:00+00:00 TriggerDagRunOperator 2021-06-13T16:10:55.737387+00:00 2021-06-13T16:10:56.364539+00:00 0:00:00.627152 40503 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T16:10:53.182336+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-13T15:00:00+00:00 TriggerDagRunOperator 2021-06-13T16:10:55.653290+00:00 2021-06-13T16:10:56.186572+00:00 0:00:00.533282 40502 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T16:10:53.182306+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-13T15:05:00+00:00 EmrJobFlowSensor 2021-06-13T16:06:06.886259+00:00 2021-06-13T16:15:09.398749+00:00 0:09:02.512490 40501 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T16:06:04.553337+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-13T15:05:00+00:00 EmrCreateJobFlowOperator 2021-06-13T16:05:40.586404+00:00 2021-06-13T16:05:42.204888+00:00 0:00:01.618484 40500 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T16:05:38.400067+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-13T15:05:00+00:00 PythonOperator 2021-06-13T16:05:14.567073+00:00 2021-06-13T16:05:17.976579+00:00 0:00:03.409506 40499 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T16:05:12.351647+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-13T15:00:00+00:00 EmrJobFlowSensor 2021-06-13T16:01:15.887991+00:00 2021-06-13T16:10:18.710260+00:00 0:09:02.822269 40498 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T16:01:13.653847+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-13T15:00:00+00:00 EmrJobFlowSensor 2021-06-13T16:01:11.832442+00:00 2021-06-13T16:13:15.142115+00:00 0:12:03.309673 40497 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T16:01:09.647900+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-13T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T16:00:55.912660+00:00 2021-06-13T16:00:57.789540+00:00 0:00:01.876880 40496 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-13T16:00:53.634440+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-13T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T16:00:49.920915+00:00 2021-06-13T16:00:51.594625+00:00 0:00:01.673710 40495 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T16:00:47.629476+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-13T15:00:00+00:00 PythonOperator 2021-06-13T16:00:27.781264+00:00 2021-06-13T16:00:31.158261+00:00 0:00:03.376997 40494 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-13T16:00:25.609375+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-13T15:00:00+00:00 PythonOperator 2021-06-13T16:00:14.076097+00:00 2021-06-13T16:00:17.634150+00:00 0:00:03.558053 40493 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T16:00:11.595758+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-13T14:00:00+00:00 EmrJobFlowSensor 2021-06-13T15:11:39.188872+00:00 2021-06-13T15:20:41.800588+00:00 0:09:02.611716 40491 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T15:11:36.991945+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-13T14:00:00+00:00 EmrJobFlowSensor 2021-06-13T15:11:37.203632+00:00 2021-06-13T15:21:40.099045+00:00 0:10:02.895413 40490 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T15:11:34.988267+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-13T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T15:11:01.203521+00:00 2021-06-13T15:11:02.953214+00:00 0:00:01.749693 40489 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T15:10:58.984072+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-13T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T15:10:57.226833+00:00 2021-06-13T15:10:59.026251+00:00 0:00:01.799418 40488 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T15:10:54.885873+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-13T14:00:00+00:00 PythonOperator 2021-06-13T15:10:37.174112+00:00 2021-06-13T15:10:40.397839+00:00 0:00:03.223727 40487 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T15:10:34.857693+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-13T14:00:00+00:00 PythonOperator 2021-06-13T15:10:35.397883+00:00 2021-06-13T15:10:39.203676+00:00 0:00:03.805793 40486 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T15:10:32.874463+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-13T14:00:00+00:00 TriggerDagRunOperator 2021-06-13T15:10:13.150113+00:00 2021-06-13T15:10:13.683650+00:00 0:00:00.533537 40485 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T15:10:10.743863+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-13T14:00:00+00:00 TriggerDagRunOperator 2021-06-13T15:10:13.016405+00:00 2021-06-13T15:10:13.409127+00:00 0:00:00.392722 40484 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T15:10:10.743833+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-13T14:05:00+00:00 EmrJobFlowSensor 2021-06-13T15:05:54.549790+00:00 2021-06-13T15:15:57.177550+00:00 0:10:02.627760 40483 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T15:05:52.357965+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-13T14:05:00+00:00 EmrCreateJobFlowOperator 2021-06-13T15:05:32.724796+00:00 2021-06-13T15:05:34.423828+00:00 0:00:01.699032 40482 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T15:05:30.354872+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-13T14:05:00+00:00 PythonOperator 2021-06-13T15:05:10.598651+00:00 2021-06-13T15:05:14.125121+00:00 0:00:03.526470 40481 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T15:05:08.258849+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-13T14:00:00+00:00 EmrJobFlowSensor 2021-06-13T15:01:00.428320+00:00 2021-06-13T15:13:03.657039+00:00 0:12:03.228719 40480 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T15:00:57.912246+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-13T14:00:00+00:00 EmrJobFlowSensor 2021-06-13T15:00:50.141482+00:00 2021-06-13T15:09:52.807562+00:00 0:09:02.666080 40479 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T15:00:47.896090+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-13T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T15:00:34.324968+00:00 2021-06-13T15:00:36.086254+00:00 0:00:01.761286 40478 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T15:00:31.885323+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-13T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T15:00:28.177596+00:00 2021-06-13T15:00:30.107366+00:00 0:00:01.929770 40477 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-13T15:00:25.843007+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-13T14:00:00+00:00 PythonOperator 2021-06-13T15:00:13.988773+00:00 2021-06-13T15:00:17.563947+00:00 0:00:03.575174 40476 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T15:00:11.827625+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-13T14:00:00+00:00 PythonOperator 2021-06-13T15:00:08.253333+00:00 2021-06-13T15:00:11.549610+00:00 0:00:03.296277 40475 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-13T15:00:05.815868+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-13T13:00:00+00:00 EmrJobFlowSensor 2021-06-13T14:10:14.758887+00:00 2021-06-13T14:20:17.568808+00:00 0:10:02.809921 40473 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T14:10:12.541000+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-13T13:00:00+00:00 EmrJobFlowSensor 2021-06-13T14:10:08.698378+00:00 2021-06-13T14:19:11.418865+00:00 0:09:02.720487 40472 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T14:10:06.536463+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-13T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T14:09:55.332961+00:00 2021-06-13T14:09:57.076502+00:00 0:00:01.743541 40471 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T14:09:52.527614+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-13T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T14:09:46.695605+00:00 2021-06-13T14:09:48.362996+00:00 0:00:01.667391 40470 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T14:09:44.519453+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-13T13:00:00+00:00 PythonOperator 2021-06-13T14:09:32.977212+00:00 2021-06-13T14:09:36.463518+00:00 0:00:03.486306 40469 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T14:09:30.559181+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-13T13:00:00+00:00 PythonOperator 2021-06-13T14:09:24.666170+00:00 2021-06-13T14:09:28.254357+00:00 0:00:03.588187 40468 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T14:09:22.510204+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-13T13:00:00+00:00 TriggerDagRunOperator 2021-06-13T14:09:20.923577+00:00 2021-06-13T14:09:21.420561+00:00 0:00:00.496984 40467 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T14:09:18.563158+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-13T13:00:00+00:00 TriggerDagRunOperator 2021-06-13T14:09:20.833064+00:00 2021-06-13T14:09:21.234001+00:00 0:00:00.400937 40466 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T14:09:18.563189+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-13T13:05:00+00:00 EmrJobFlowSensor 2021-06-13T14:06:04.734099+00:00 2021-06-13T14:15:07.324811+00:00 0:09:02.590712 40465 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T14:06:02.258145+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-13T13:05:00+00:00 EmrCreateJobFlowOperator 2021-06-13T14:05:42.454109+00:00 2021-06-13T14:05:44.225192+00:00 0:00:01.771083 40464 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T14:05:40.160016+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-13T13:05:00+00:00 PythonOperator 2021-06-13T14:05:20.285006+00:00 2021-06-13T14:05:23.643084+00:00 0:00:03.358078 40463 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T14:05:18.137257+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-13T13:00:00+00:00 EmrJobFlowSensor 2021-06-13T14:01:18.094911+00:00 2021-06-13T14:13:21.230705+00:00 0:12:03.135794 40462 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T14:01:15.837378+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-13T13:00:00+00:00 EmrJobFlowSensor 2021-06-13T14:00:56.051562+00:00 2021-06-13T14:08:58.590024+00:00 0:08:02.538462 40461 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T14:00:53.820914+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-13T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T14:00:40.071646+00:00 2021-06-13T14:00:41.710466+00:00 0:00:01.638820 40460 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T14:00:37.860539+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-13T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T14:00:30.396540+00:00 2021-06-13T14:00:32.206211+00:00 0:00:01.809671 40459 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-13T14:00:27.953530+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-13T13:00:00+00:00 PythonOperator 2021-06-13T14:00:18.411988+00:00 2021-06-13T14:00:21.792560+00:00 0:00:03.380572 40458 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T14:00:15.784383+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-13T13:00:00+00:00 PythonOperator 2021-06-13T14:00:10.030623+00:00 2021-06-13T14:00:13.307573+00:00 0:00:03.276950 40457 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-13T14:00:07.759610+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-13T12:00:00+00:00 EmrJobFlowSensor 2021-06-13T13:13:10.522381+00:00 2021-06-13T13:23:13.352731+00:00 0:10:02.830350 40456 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T13:13:08.358320+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-13T12:00:00+00:00 EmrJobFlowSensor 2021-06-13T13:13:02.576748+00:00 2021-06-13T13:23:05.433126+00:00 0:10:02.856378 40455 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-13T13:13:00.360559+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-13T12:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T13:12:49.179389+00:00 2021-06-13T13:12:50.847628+00:00 0:00:01.668239 40454 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T13:12:46.367997+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-13T12:00:00+00:00 EmrCreateJobFlowOperator 2021-06-13T13:12:40.436973+00:00 2021-06-13T13:12:42.125733+00:00 0:00:01.688760 40453 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-13T13:12:38.289892+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-13T12:00:00+00:00 PythonOperator 2021-06-13T13:12:26.695524+00:00 2021-06-13T13:12:29.912956+00:00 0:00:03.217432 40452 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-13T13:12:24.298226+00:00 2 default_pool