The scheduler does not appear to be running. Last heartbeat was received .

The DAGs list may not update, and new tasks will not be scheduled.

Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-11T04:00:00+00:00 PythonOperator 2021-06-11T05:00:07.660006+00:00 2021-06-11T05:00:11.026654+00:00 0:00:03.366648 39413 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T05:00:05.287599+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-11T03:00:00+00:00 EmrJobFlowSensor 2021-06-11T04:12:16.830448+00:00 2021-06-11T04:22:19.707200+00:00 0:10:02.876752 39411 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T04:12:14.497612+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-11T03:00:00+00:00 EmrJobFlowSensor 2021-06-11T04:12:10.988976+00:00 2021-06-11T04:22:13.812884+00:00 0:10:02.823908 39410 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T04:12:08.554573+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-11T03:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T04:11:56.713895+00:00 2021-06-11T04:11:58.446882+00:00 0:00:01.732987 39409 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T04:11:54.429370+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-11T03:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T04:11:50.636311+00:00 2021-06-11T04:11:52.339705+00:00 0:00:01.703394 39408 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T04:11:48.474100+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-11T03:00:00+00:00 PythonOperator 2021-06-11T04:11:34.807334+00:00 2021-06-11T04:11:38.284967+00:00 0:00:03.477633 39407 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T04:11:32.457278+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-11T03:00:00+00:00 PythonOperator 2021-06-11T04:11:28.585216+00:00 2021-06-11T04:11:32.020925+00:00 0:00:03.435709 39406 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T04:11:26.413827+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-11T03:00:00+00:00 TriggerDagRunOperator 2021-06-11T04:11:08.680673+00:00 2021-06-11T04:11:09.180700+00:00 0:00:00.500027 39405 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T04:11:06.390749+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-11T03:00:00+00:00 TriggerDagRunOperator 2021-06-11T04:11:08.562325+00:00 2021-06-11T04:11:08.975693+00:00 0:00:00.413368 39404 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T04:11:06.390717+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-11T03:05:00+00:00 EmrJobFlowSensor 2021-06-11T04:06:22.062786+00:00 2021-06-11T04:14:24.526832+00:00 0:08:02.464046 39403 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T04:06:19.959120+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-11T03:05:00+00:00 EmrCreateJobFlowOperator 2021-06-11T04:05:48.155660+00:00 2021-06-11T04:05:49.920856+00:00 0:00:01.765196 39402 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T04:05:45.946315+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-11T03:05:00+00:00 PythonOperator 2021-06-11T04:05:22.179084+00:00 2021-06-11T04:05:25.427823+00:00 0:00:03.248739 39401 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T04:05:19.909682+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-11T03:00:00+00:00 EmrJobFlowSensor 2021-06-11T04:00:51.763838+00:00 2021-06-11T04:10:54.648075+00:00 0:10:02.884237 39400 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T04:00:49.537567+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-11T03:00:00+00:00 EmrJobFlowSensor 2021-06-11T04:00:47.771871+00:00 2021-06-11T04:12:50.666828+00:00 0:12:02.894957 39399 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T04:00:45.533512+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-11T03:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T04:00:31.700175+00:00 2021-06-11T04:00:33.479415+00:00 0:00:01.779240 39398 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-11T04:00:29.517392+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-11T03:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T04:00:25.641383+00:00 2021-06-11T04:00:27.291783+00:00 0:00:01.650400 39397 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T04:00:23.512682+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-11T03:00:00+00:00 PythonOperator 2021-06-11T04:00:10.919678+00:00 2021-06-11T04:00:14.471454+00:00 0:00:03.551776 39396 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-11T04:00:07.522837+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-11T03:00:00+00:00 PythonOperator 2021-06-11T04:00:05.990834+00:00 2021-06-11T04:00:10.753458+00:00 0:00:04.762624 39395 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T04:00:03.494933+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-11T02:00:00+00:00 EmrJobFlowSensor 2021-06-11T03:15:55.607684+00:00 2021-06-11T03:25:58.544239+00:00 0:10:02.936555 39394 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T03:15:53.285053+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-11T02:00:00+00:00 EmrJobFlowSensor 2021-06-11T03:15:49.469472+00:00 2021-06-11T03:24:52.002960+00:00 0:09:02.533488 39393 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T03:15:47.273260+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-11T02:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T03:15:33.594295+00:00 2021-06-11T03:15:35.395211+00:00 0:00:01.800916 39392 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T03:15:31.259433+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-11T02:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T03:15:27.847356+00:00 2021-06-11T03:15:29.730538+00:00 0:00:01.883182 39391 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T03:15:25.258368+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-11T02:00:00+00:00 PythonOperator 2021-06-11T03:09:45.622313+00:00 2021-06-11T03:09:49.111898+00:00 0:00:03.489585 39389 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T03:09:43.336636+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-11T02:00:00+00:00 PythonOperator 2021-06-11T03:09:40.149659+00:00 2021-06-11T03:09:43.703497+00:00 0:00:03.553838 39388 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T03:09:37.444251+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-11T02:00:00+00:00 TriggerDagRunOperator 2021-06-11T03:09:31.786462+00:00 2021-06-11T03:09:32.289578+00:00 0:00:00.503116 39387 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T03:09:29.384500+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-11T02:00:00+00:00 TriggerDagRunOperator 2021-06-11T03:09:31.714726+00:00 2021-06-11T03:09:32.109411+00:00 0:00:00.394685 39386 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T03:09:29.384468+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-11T02:05:00+00:00 EmrJobFlowSensor 2021-06-11T03:05:51.191690+00:00 2021-06-11T03:13:53.552366+00:00 0:08:02.360676 39385 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T03:05:49.043637+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-11T02:05:00+00:00 EmrCreateJobFlowOperator 2021-06-11T03:05:29.174611+00:00 2021-06-11T03:05:30.836709+00:00 0:00:01.662098 39384 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T03:05:27.023367+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-11T02:05:00+00:00 PythonOperator 2021-06-11T03:05:09.356950+00:00 2021-06-11T03:05:12.709077+00:00 0:00:03.352127 39383 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T03:05:07.001966+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-11T02:00:00+00:00 EmrJobFlowSensor 2021-06-11T03:01:06.630343+00:00 2021-06-11T03:09:09.165761+00:00 0:08:02.535418 39382 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T03:01:04.482654+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-11T02:00:00+00:00 EmrJobFlowSensor 2021-06-11T03:00:49.035944+00:00 2021-06-11T03:12:52.070320+00:00 0:12:03.034376 39381 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T03:00:46.470650+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-11T02:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T03:00:46.602828+00:00 2021-06-11T03:00:48.678365+00:00 0:00:02.075537 39380 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-11T03:00:44.463371+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-11T02:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T03:00:27.432292+00:00 2021-06-11T03:00:29.240793+00:00 0:00:01.808501 39379 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T03:00:24.448422+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-11T02:00:00+00:00 PythonOperator 2021-06-11T03:00:25.161690+00:00 2021-06-11T03:00:28.827438+00:00 0:00:03.665748 39378 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-11T03:00:22.449741+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-11T02:00:00+00:00 PythonOperator 2021-06-11T03:00:05.001542+00:00 2021-06-11T03:00:08.448820+00:00 0:00:03.447278 39377 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T03:00:02.454331+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-11T01:00:00+00:00 EmrJobFlowSensor 2021-06-11T02:12:15.490348+00:00 2021-06-11T02:21:18.095021+00:00 0:09:02.604673 39376 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T02:12:13.207892+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-11T01:00:00+00:00 EmrJobFlowSensor 2021-06-11T02:12:01.383387+00:00 2021-06-11T02:22:04.138182+00:00 0:10:02.754795 39375 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T02:11:59.197452+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-11T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T02:11:49.582575+00:00 2021-06-11T02:11:51.282117+00:00 0:00:01.699542 39374 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T02:11:47.251585+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-11T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T02:11:37.566602+00:00 2021-06-11T02:11:39.283683+00:00 0:00:01.717081 39373 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T02:11:35.160802+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-11T01:00:00+00:00 PythonOperator 2021-06-11T02:11:29.644105+00:00 2021-06-11T02:11:33.149662+00:00 0:00:03.505557 39372 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T02:11:27.158054+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-11T01:00:00+00:00 PythonOperator 2021-06-11T02:11:15.588363+00:00 2021-06-11T02:11:19.057472+00:00 0:00:03.469109 39371 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T02:11:13.152645+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-11T01:00:00+00:00 TriggerDagRunOperator 2021-06-11T02:11:10.092643+00:00 2021-06-11T02:11:10.601160+00:00 0:00:00.508517 39370 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T02:11:06.949723+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-11T01:00:00+00:00 TriggerDagRunOperator 2021-06-11T02:11:09.981604+00:00 2021-06-11T02:11:10.417784+00:00 0:00:00.436180 39369 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T02:11:06.949677+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-11T01:05:00+00:00 EmrJobFlowSensor 2021-06-11T02:06:17.551517+00:00 2021-06-11T02:14:19.993149+00:00 0:08:02.441632 39367 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T02:06:15.351058+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-11T01:05:00+00:00 EmrCreateJobFlowOperator 2021-06-11T02:05:47.461991+00:00 2021-06-11T02:05:49.209914+00:00 0:00:01.747923 39366 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T02:05:45.320904+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-11T01:05:00+00:00 PythonOperator 2021-06-11T02:05:17.793990+00:00 2021-06-11T02:05:21.152983+00:00 0:00:03.358993 39365 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T02:05:15.360712+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-11T01:00:00+00:00 EmrJobFlowSensor 2021-06-11T02:00:59.219273+00:00 2021-06-11T02:12:02.066540+00:00 0:11:02.847267 39364 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T02:00:56.931558+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-11T01:00:00+00:00 EmrJobFlowSensor 2021-06-11T02:00:55.366064+00:00 2021-06-11T02:10:58.272711+00:00 0:10:02.906647 39363 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T02:00:52.983599+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-11T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T02:00:39.157427+00:00 2021-06-11T02:00:40.797294+00:00 0:00:01.639867 39362 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T02:00:36.915036+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-11T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T02:00:35.075840+00:00 2021-06-11T02:00:36.756167+00:00 0:00:01.680327 39361 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-11T02:00:32.908329+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-11T01:00:00+00:00 PythonOperator 2021-06-11T02:00:18.009202+00:00 2021-06-11T02:00:21.676407+00:00 0:00:03.667205 39360 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T02:00:14.896500+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-11T01:00:00+00:00 PythonOperator 2021-06-11T02:00:13.297291+00:00 2021-06-11T02:00:17.546272+00:00 0:00:04.248981 39359 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-11T02:00:10.891745+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-11T00:00:00+00:00 EmrJobFlowSensor 2021-06-11T01:12:32.332839+00:00 2021-06-11T01:22:35.130685+00:00 0:10:02.797846 39358 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T01:12:29.912873+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-11T00:00:00+00:00 EmrJobFlowSensor 2021-06-11T01:12:24.439825+00:00 2021-06-11T01:22:27.188565+00:00 0:10:02.748740 39357 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T01:12:21.905044+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-11T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T01:12:10.358418+00:00 2021-06-11T01:12:12.143217+00:00 0:00:01.784799 39356 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T01:12:07.959868+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-11T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T01:12:02.362192+00:00 2021-06-11T01:12:04.194875+00:00 0:00:01.832683 39355 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T01:11:59.959073+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-11T00:00:00+00:00 PythonOperator 2021-06-11T01:11:38.055342+00:00 2021-06-11T01:11:41.653982+00:00 0:00:03.598640 39354 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T01:11:35.828815+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-11T00:00:00+00:00 PythonOperator 2021-06-11T01:11:27.995704+00:00 2021-06-11T01:11:31.494856+00:00 0:00:03.499152 39353 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T01:11:25.821635+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-11T00:00:00+00:00 TriggerDagRunOperator 2021-06-11T01:11:22.096199+00:00 2021-06-11T01:11:22.637460+00:00 0:00:00.541261 39352 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T01:11:19.815943+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-11T00:00:00+00:00 TriggerDagRunOperator 2021-06-11T01:11:22.003613+00:00 2021-06-11T01:11:22.460227+00:00 0:00:00.456614 39351 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T01:11:19.815977+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-11T00:05:00+00:00 EmrJobFlowSensor 2021-06-11T01:09:02.088511+00:00 2021-06-11T01:18:04.730379+00:00 0:09:02.641868 39350 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T01:08:59.661920+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-11T00:05:00+00:00 EmrCreateJobFlowOperator 2021-06-11T01:08:41.668071+00:00 2021-06-11T01:08:43.376851+00:00 0:00:01.708780 39349 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T01:08:39.474642+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-11T00:05:00+00:00 PythonOperator 2021-06-11T01:08:20.064189+00:00 2021-06-11T01:08:23.424516+00:00 0:00:03.360327 39348 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T01:08:17.512714+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-11T00:00:00+00:00 EmrJobFlowSensor 2021-06-11T01:01:06.952692+00:00 2021-06-11T01:11:09.762624+00:00 0:10:02.809932 39346 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T01:01:04.689069+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-11T00:00:00+00:00 EmrJobFlowSensor 2021-06-11T01:00:58.900642+00:00 2021-06-11T01:13:02.021624+00:00 0:12:03.120982 39345 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T01:00:56.656460+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-11T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T01:00:44.912456+00:00 2021-06-11T01:00:46.792254+00:00 0:00:01.879798 39344 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-11T01:00:42.645452+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-11T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T01:00:38.756342+00:00 2021-06-11T01:00:40.370487+00:00 0:00:01.614145 39343 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T01:00:36.639725+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-11T00:00:00+00:00 PythonOperator 2021-06-11T01:00:23.014800+00:00 2021-06-11T01:00:26.333586+00:00 0:00:03.318786 39342 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-11T01:00:20.626464+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-11T00:00:00+00:00 PythonOperator 2021-06-11T01:00:16.908096+00:00 2021-06-11T01:00:20.492394+00:00 0:00:03.584298 39341 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T01:00:14.657576+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-10T23:00:00+00:00 EmrJobFlowSensor 2021-06-11T00:27:05.902423+00:00 2021-06-11T00:27:07.504048+00:00 0:00:01.601625 39340 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T00:27:03.542680+00:00 3 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-10T23:00:00+00:00 EmrJobFlowSensor 2021-06-11T00:26:59.945206+00:00 2021-06-11T00:27:01.460057+00:00 0:00:01.514851 39339 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T00:26:57.556669+00:00 3 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-10T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T00:14:18.782597+00:00 2021-06-11T00:14:20.572290+00:00 0:00:01.789693 39336 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T00:14:16.154594+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-10T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T00:14:18.660457+00:00 2021-06-11T00:14:20.406843+00:00 0:00:01.746386 39335 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T00:14:16.154636+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-10T23:00:00+00:00 PythonOperator 2021-06-11T00:13:59.117014+00:00 2021-06-11T00:14:02.532777+00:00 0:00:03.415763 39334 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T00:13:56.067169+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-10T23:00:00+00:00 PythonOperator 2021-06-11T00:13:56.681271+00:00 2021-06-11T00:14:00.423061+00:00 0:00:03.741790 39333 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T00:13:54.064202+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-10T23:00:00+00:00 TriggerDagRunOperator 2021-06-11T00:13:34.682762+00:00 2021-06-11T00:13:35.274693+00:00 0:00:00.591931 39332 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T00:13:32.053573+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-10T23:00:00+00:00 TriggerDagRunOperator 2021-06-11T00:13:34.421474+00:00 2021-06-11T00:13:34.823039+00:00 0:00:00.401565 39331 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T00:13:32.053623+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-10T23:05:00+00:00 EmrJobFlowSensor 2021-06-11T00:06:13.563129+00:00 2021-06-11T00:14:16.094689+00:00 0:08:02.531560 39330 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T00:06:11.258998+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-10T23:05:00+00:00 EmrCreateJobFlowOperator 2021-06-11T00:05:39.589303+00:00 2021-06-11T00:05:41.320318+00:00 0:00:01.731015 39329 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T00:05:37.212625+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-10T23:05:00+00:00 PythonOperator 2021-06-11T00:05:15.396364+00:00 2021-06-11T00:05:18.781985+00:00 0:00:03.385621 39328 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T00:05:13.259617+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-10T23:00:00+00:00 EmrJobFlowSensor 2021-06-11T00:04:17.490932+00:00 2021-06-11T00:13:20.161013+00:00 0:09:02.670081 39327 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T00:04:15.178291+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-10T23:00:00+00:00 EmrJobFlowSensor 2021-06-11T00:04:15.557622+00:00 2021-06-11T00:15:18.399023+00:00 0:11:02.841401 39326 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-11T00:04:13.175579+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-10T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T00:03:55.738166+00:00 2021-06-11T00:03:57.486032+00:00 0:00:01.747866 39325 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-11T00:03:53.097654+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-10T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-11T00:03:53.341733+00:00 2021-06-11T00:03:55.400116+00:00 0:00:02.058383 39324 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-11T00:03:51.092996+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-10T23:00:00+00:00 PythonOperator 2021-06-11T00:03:35.507961+00:00 2021-06-11T00:03:38.854724+00:00 0:00:03.346763 39323 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-11T00:03:33.077582+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-10T23:00:00+00:00 PythonOperator 2021-06-11T00:03:33.399568+00:00 2021-06-11T00:03:36.983001+00:00 0:00:03.583433 39322 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-11T00:03:31.081736+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-10T22:00:00+00:00 EmrJobFlowSensor 2021-06-10T23:11:17.114399+00:00 2021-06-10T23:21:19.882294+00:00 0:10:02.767895 39320 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-10T23:11:14.965546+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-10T22:00:00+00:00 EmrJobFlowSensor 2021-06-10T23:11:15.252452+00:00 2021-06-10T23:21:18.007244+00:00 0:10:02.754792 39319 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-10T23:11:12.903860+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-10T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-10T23:10:55.300564+00:00 2021-06-10T23:10:57.093151+00:00 0:00:01.792587 39318 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-10T23:10:52.940691+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-10T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-10T23:10:53.373502+00:00 2021-06-10T23:10:55.072105+00:00 0:00:01.698603 39317 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-10T23:10:50.953156+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-10T22:00:00+00:00 PythonOperator 2021-06-10T23:10:35.352620+00:00 2021-06-10T23:10:38.964688+00:00 0:00:03.612068 39316 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-10T23:10:32.785869+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-10T22:00:00+00:00 PythonOperator 2021-06-10T23:10:33.780659+00:00 2021-06-10T23:10:36.961251+00:00 0:00:03.180592 39315 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-10T23:10:30.843671+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-10T22:00:00+00:00 TriggerDagRunOperator 2021-06-10T23:10:25.417055+00:00 2021-06-10T23:10:25.802648+00:00 0:00:00.385593 39314 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-10T23:10:22.777297+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-10T22:00:00+00:00 TriggerDagRunOperator 2021-06-10T23:10:25.330958+00:00 2021-06-10T23:10:25.842936+00:00 0:00:00.511978 39313 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-10T23:10:22.777328+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-10T22:05:00+00:00 EmrJobFlowSensor 2021-06-10T23:05:56.521008+00:00 2021-06-10T23:14:59.178213+00:00 0:09:02.657205 39312 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-10T23:05:54.246131+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-10T22:05:00+00:00 EmrCreateJobFlowOperator 2021-06-10T23:05:36.517238+00:00 2021-06-10T23:05:38.288779+00:00 0:00:01.771541 39311 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-10T23:05:34.243204+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-10T22:05:00+00:00 PythonOperator 2021-06-10T23:05:14.659492+00:00 2021-06-10T23:05:18.063257+00:00 0:00:03.403765 39310 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-10T23:05:12.264899+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-10T22:00:00+00:00 EmrJobFlowSensor 2021-06-10T23:01:02.661924+00:00 2021-06-10T23:10:05.195270+00:00 0:09:02.533346 39309 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-10T23:00:59.946114+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-10T22:00:00+00:00 EmrJobFlowSensor 2021-06-10T23:01:00.339158+00:00 2021-06-10T23:11:03.362237+00:00 0:10:03.023079 39308 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-10T23:00:57.943387+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 check_cluster_status 2021-06-09T23:00:00+00:00 EmrJobFlowSensor 2021-06-10T23:00:50.184291+00:00 2021-06-10T23:10:52.948357+00:00 0:10:02.764066 39307 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-10T23:00:47.828476+00:00 2 default_pool