The scheduler does not appear to be running. Last heartbeat was received .

The DAGs list may not update, and new tasks will not be scheduled.

Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
failed livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-18T17:00:00+00:00 EmrJobFlowSensor 2021-06-18T18:17:28.165218+00:00 2021-06-18T18:17:29.638519+00:00 0:00:01.473301 42841 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T18:17:25.800709+00:00 6 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-18T17:00:00+00:00 EmrJobFlowSensor 2021-06-18T18:11:15.533301+00:00 2021-06-18T18:23:18.530857+00:00 0:12:02.997556 42837 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T18:11:13.197081+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-18T17:00:00+00:00 EmrJobFlowSensor 2021-06-18T18:11:09.422271+00:00 2021-06-18T18:21:12.221687+00:00 0:10:02.799416 42836 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T18:11:07.197824+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T18:10:55.649441+00:00 2021-06-18T18:10:57.401129+00:00 0:00:01.751688 42835 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T18:10:53.118995+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T18:10:47.736291+00:00 2021-06-18T18:10:49.409423+00:00 0:00:01.673132 42834 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T18:10:45.244791+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-18T17:00:00+00:00 PythonOperator 2021-06-18T18:10:33.732528+00:00 2021-06-18T18:10:37.458051+00:00 0:00:03.725523 42833 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T18:10:31.105873+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-18T17:00:00+00:00 PythonOperator 2021-06-18T18:10:25.681017+00:00 2021-06-18T18:10:29.238900+00:00 0:00:03.557883 42832 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T18:10:23.162419+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-18T17:00:00+00:00 TriggerDagRunOperator 2021-06-18T18:10:11.319151+00:00 2021-06-18T18:10:11.818263+00:00 0:00:00.499112 42831 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T18:10:09.089796+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-18T17:00:00+00:00 TriggerDagRunOperator 2021-06-18T18:10:11.250172+00:00 2021-06-18T18:10:11.650214+00:00 0:00:00.400042 42830 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T18:10:09.089852+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-18T17:05:00+00:00 EmrJobFlowSensor 2021-06-18T18:05:52.747247+00:00 2021-06-18T18:14:55.362456+00:00 0:09:02.615209 42829 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T18:05:50.590450+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-18T17:05:00+00:00 EmrCreateJobFlowOperator 2021-06-18T18:05:30.822821+00:00 2021-06-18T18:05:32.482881+00:00 0:00:01.660060 42828 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T18:05:28.569563+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-18T17:05:00+00:00 PythonOperator 2021-06-18T18:05:10.862999+00:00 2021-06-18T18:05:14.206943+00:00 0:00:03.343944 42827 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T18:05:08.551881+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-18T17:00:00+00:00 EmrJobFlowSensor 2021-06-18T18:01:04.595097+00:00 2021-06-18T18:10:07.371265+00:00 0:09:02.776168 42826 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T18:01:02.066490+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T18:00:40.602674+00:00 2021-06-18T18:00:42.448673+00:00 0:00:01.845999 42824 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-18T18:00:37.990370+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T18:00:34.289282+00:00 2021-06-18T18:00:36.068475+00:00 0:00:01.779193 42823 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T18:00:31.982032+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-18T17:00:00+00:00 PythonOperator 2021-06-18T18:00:18.089326+00:00 2021-06-18T18:00:21.583977+00:00 0:00:03.494651 42822 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-18T18:00:15.923510+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-18T17:00:00+00:00 PythonOperator 2021-06-18T18:00:12.154084+00:00 2021-06-18T18:00:15.621683+00:00 0:00:03.467599 42821 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T18:00:09.918292+00:00 2 default_pool
failed livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-18T16:00:00+00:00 EmrJobFlowSensor 2021-06-18T17:16:30.556950+00:00 2021-06-18T17:16:31.985110+00:00 0:00:01.428160 42819 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T17:16:28.050710+00:00 6 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-18T16:00:00+00:00 EmrJobFlowSensor 2021-06-18T17:11:33.961401+00:00 2021-06-18T17:21:36.884320+00:00 0:10:02.922919 42815 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T17:11:31.460865+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-18T16:00:00+00:00 EmrJobFlowSensor 2021-06-18T17:11:31.910960+00:00 2021-06-18T17:19:34.401976+00:00 0:08:02.491016 42814 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T17:11:29.548564+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T17:11:11.998575+00:00 2021-06-18T17:11:13.799088+00:00 0:00:01.800513 42813 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T17:11:09.374676+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T17:11:09.691618+00:00 2021-06-18T17:11:11.759924+00:00 0:00:02.068306 42812 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T17:11:07.372867+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-18T16:00:00+00:00 PythonOperator 2021-06-18T17:10:47.564142+00:00 2021-06-18T17:10:51.086912+00:00 0:00:03.522770 42811 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T17:10:45.340848+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-18T16:00:00+00:00 PythonOperator 2021-06-18T17:10:35.590258+00:00 2021-06-18T17:10:38.910627+00:00 0:00:03.320369 42810 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T17:10:33.335719+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-18T16:00:00+00:00 TriggerDagRunOperator 2021-06-18T17:10:25.632799+00:00 2021-06-18T17:10:26.157896+00:00 0:00:00.525097 42809 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T17:10:23.323334+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-18T16:00:00+00:00 TriggerDagRunOperator 2021-06-18T17:10:25.577690+00:00 2021-06-18T17:10:25.959703+00:00 0:00:00.382013 42808 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T17:10:23.323370+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-18T16:05:00+00:00 EmrJobFlowSensor 2021-06-18T17:06:03.249611+00:00 2021-06-18T17:15:05.818614+00:00 0:09:02.569003 42807 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T17:06:01.027782+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-18T16:05:00+00:00 EmrCreateJobFlowOperator 2021-06-18T17:05:41.165088+00:00 2021-06-18T17:05:42.891750+00:00 0:00:01.726662 42806 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T17:05:39.007377+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-18T16:05:00+00:00 PythonOperator 2021-06-18T17:05:19.093093+00:00 2021-06-18T17:05:22.728009+00:00 0:00:03.634916 42805 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T17:05:16.926597+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-18T16:00:00+00:00 EmrJobFlowSensor 2021-06-18T17:01:06.584024+00:00 2021-06-18T17:10:09.324745+00:00 0:09:02.740721 42803 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T17:01:04.452520+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T17:00:54.645690+00:00 2021-06-18T17:00:56.324887+00:00 0:00:01.679197 42802 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T17:00:52.441165+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T17:00:34.723224+00:00 2021-06-18T17:00:36.469667+00:00 0:00:01.746443 42801 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-18T17:00:32.428418+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-18T16:00:00+00:00 PythonOperator 2021-06-18T17:00:10.658681+00:00 2021-06-18T17:00:14.109050+00:00 0:00:03.450369 42800 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T17:00:08.406863+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-18T16:00:00+00:00 PythonOperator 2021-06-18T17:00:08.758853+00:00 2021-06-18T17:00:12.349464+00:00 0:00:03.590611 42799 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-18T17:00:06.401524+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-18T15:00:00+00:00 EmrJobFlowSensor 2021-06-18T16:12:46.926064+00:00 2021-06-18T16:22:49.624452+00:00 0:10:02.698388 42797 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T16:12:44.793241+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-18T15:00:00+00:00 EmrJobFlowSensor 2021-06-18T16:12:43.089537+00:00 2021-06-18T16:21:45.884845+00:00 0:09:02.795308 42796 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T16:12:40.791871+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T16:12:27.181127+00:00 2021-06-18T16:12:29.004670+00:00 0:00:01.823543 42795 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T16:12:24.780069+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T16:12:21.095511+00:00 2021-06-18T16:12:22.812446+00:00 0:00:01.716935 42794 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T16:12:18.781503+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-18T15:00:00+00:00 PythonOperator 2021-06-18T16:12:05.325976+00:00 2021-06-18T16:12:08.923935+00:00 0:00:03.597959 42793 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T16:12:02.771636+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-18T15:00:00+00:00 PythonOperator 2021-06-18T16:11:59.240444+00:00 2021-06-18T16:12:03.081570+00:00 0:00:03.841126 42792 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T16:11:56.686203+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-18T15:00:00+00:00 TriggerDagRunOperator 2021-06-18T16:11:55.046571+00:00 2021-06-18T16:11:55.526762+00:00 0:00:00.480191 42791 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T16:11:52.652301+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-18T15:00:00+00:00 TriggerDagRunOperator 2021-06-18T16:11:54.856251+00:00 2021-06-18T16:11:55.254253+00:00 0:00:00.398002 42790 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T16:11:52.652334+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-18T15:05:00+00:00 EmrJobFlowSensor 2021-06-18T16:05:52.176664+00:00 2021-06-18T16:13:54.813222+00:00 0:08:02.636558 42789 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T16:05:49.998519+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-18T15:05:00+00:00 EmrCreateJobFlowOperator 2021-06-18T16:05:30.538127+00:00 2021-06-18T16:05:32.290989+00:00 0:00:01.752862 42788 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T16:05:28.060659+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-18T15:05:00+00:00 PythonOperator 2021-06-18T16:05:08.389341+00:00 2021-06-18T16:05:11.885707+00:00 0:00:03.496366 42787 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T16:05:05.956818+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-18T15:00:00+00:00 EmrJobFlowSensor 2021-06-18T16:01:11.848870+00:00 2021-06-18T16:11:14.637047+00:00 0:10:02.788177 42786 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T16:01:09.447746+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-18T15:00:00+00:00 EmrJobFlowSensor 2021-06-18T16:01:10.151384+00:00 2021-06-18T16:13:13.150822+00:00 0:12:02.999438 42785 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T16:01:07.479518+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T16:00:43.892878+00:00 2021-06-18T16:00:45.715230+00:00 0:00:01.822352 42784 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T16:00:41.422921+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T16:00:43.887874+00:00 2021-06-18T16:00:45.728573+00:00 0:00:01.840699 42783 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-18T16:00:41.422887+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-18T15:00:00+00:00 PythonOperator 2021-06-18T16:00:23.696430+00:00 2021-06-18T16:00:27.157647+00:00 0:00:03.461217 42782 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T16:00:21.408311+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-18T15:00:00+00:00 PythonOperator 2021-06-18T16:00:21.727422+00:00 2021-06-18T16:00:25.316042+00:00 0:00:03.588620 42781 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-18T16:00:19.403544+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-18T14:00:00+00:00 EmrJobFlowSensor 2021-06-18T15:12:24.695991+00:00 2021-06-18T15:22:27.523661+00:00 0:10:02.827670 42779 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T15:12:22.373621+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-18T14:00:00+00:00 EmrJobFlowSensor 2021-06-18T15:12:22.951205+00:00 2021-06-18T15:22:25.813609+00:00 0:10:02.862404 42778 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T15:12:20.377613+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T15:12:03.478228+00:00 2021-06-18T15:12:05.204766+00:00 0:00:01.726538 42777 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T15:12:00.372158+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T15:12:01.331611+00:00 2021-06-18T15:12:03.394069+00:00 0:00:02.062458 42776 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T15:11:58.456792+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-18T14:00:00+00:00 PythonOperator 2021-06-18T15:11:40.751669+00:00 2021-06-18T15:11:44.072035+00:00 0:00:03.320366 42775 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T15:11:38.352719+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-18T14:00:00+00:00 PythonOperator 2021-06-18T15:11:38.675329+00:00 2021-06-18T15:11:42.403713+00:00 0:00:03.728384 42774 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T15:11:36.362427+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-18T14:00:00+00:00 TriggerDagRunOperator 2021-06-18T15:11:20.847974+00:00 2021-06-18T15:11:21.352776+00:00 0:00:00.504802 42773 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T15:11:18.280539+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-18T14:00:00+00:00 TriggerDagRunOperator 2021-06-18T15:11:20.798940+00:00 2021-06-18T15:11:21.181813+00:00 0:00:00.382873 42772 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T15:11:18.280478+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-18T14:05:00+00:00 EmrJobFlowSensor 2021-06-18T15:06:58.079648+00:00 2021-06-18T15:16:00.786831+00:00 0:09:02.707183 42771 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T15:06:55.753602+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-18T14:05:00+00:00 EmrCreateJobFlowOperator 2021-06-18T15:06:38.242378+00:00 2021-06-18T15:06:40.056900+00:00 0:00:01.814522 42770 airflow-worker-2.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T15:06:35.644539+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-18T14:05:00+00:00 PythonOperator 2021-06-18T15:05:17.778708+00:00 2021-06-18T15:05:20.969713+00:00 0:00:03.191005 42769 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T15:05:15.524090+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-18T14:00:00+00:00 EmrJobFlowSensor 2021-06-18T15:01:03.406643+00:00 2021-06-18T15:12:06.317444+00:00 0:11:02.910801 42768 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T15:01:01.181142+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-18T14:00:00+00:00 EmrJobFlowSensor 2021-06-18T15:00:59.469416+00:00 2021-06-18T15:11:02.307922+00:00 0:10:02.838506 42767 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T15:00:57.178651+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T15:00:41.623447+00:00 2021-06-18T15:00:43.290871+00:00 0:00:01.667424 42766 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T15:00:39.162644+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T15:00:37.321560+00:00 2021-06-18T15:00:39.072380+00:00 0:00:01.750820 42765 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-18T15:00:35.158830+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-18T14:00:00+00:00 PythonOperator 2021-06-18T15:00:19.979446+00:00 2021-06-18T15:00:23.508948+00:00 0:00:03.529502 42764 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T15:00:17.093299+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-18T14:00:00+00:00 PythonOperator 2021-06-18T15:00:15.438539+00:00 2021-06-18T15:00:19.475181+00:00 0:00:04.036642 42763 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-18T15:00:13.090241+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-18T13:00:00+00:00 EmrJobFlowSensor 2021-06-18T14:19:09.028108+00:00 2021-06-18T14:31:12.148778+00:00 0:12:03.120670 42762 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T14:19:06.767235+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-18T13:00:00+00:00 EmrJobFlowSensor 2021-06-18T14:19:05.051700+00:00 2021-06-18T14:28:08.074026+00:00 0:09:03.022326 42761 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T14:19:02.698438+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T14:18:49.174990+00:00 2021-06-18T14:18:50.904410+00:00 0:00:01.729420 42760 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T14:18:46.687392+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T14:18:42.831601+00:00 2021-06-18T14:18:44.526489+00:00 0:00:01.694888 42759 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T14:18:40.644312+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-18T13:00:00+00:00 PythonOperator 2021-06-18T14:18:26.786436+00:00 2021-06-18T14:18:30.579143+00:00 0:00:03.792707 42758 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T14:18:24.633388+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-18T13:00:00+00:00 PythonOperator 2021-06-18T14:18:20.789531+00:00 2021-06-18T14:18:24.362618+00:00 0:00:03.573087 42757 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T14:18:18.626920+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-18T13:00:00+00:00 TriggerDagRunOperator 2021-06-18T14:18:11.232211+00:00 2021-06-18T14:18:11.747251+00:00 0:00:00.515040 42756 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T14:18:08.618534+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-18T13:00:00+00:00 TriggerDagRunOperator 2021-06-18T14:18:11.164361+00:00 2021-06-18T14:18:11.577440+00:00 0:00:00.413079 42755 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T14:18:08.618505+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-18T13:05:00+00:00 EmrJobFlowSensor 2021-06-18T14:06:06.981094+00:00 2021-06-18T14:14:09.555937+00:00 0:08:02.574843 42753 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T14:06:04.829696+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-18T13:05:00+00:00 EmrCreateJobFlowOperator 2021-06-18T14:05:35.069187+00:00 2021-06-18T14:05:36.830423+00:00 0:00:01.761236 42752 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T14:05:32.799272+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-18T13:05:00+00:00 PythonOperator 2021-06-18T14:05:13.044500+00:00 2021-06-18T14:05:16.503617+00:00 0:00:03.459117 42751 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T14:05:10.789153+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-18T13:00:00+00:00 EmrJobFlowSensor 2021-06-18T14:01:00.650600+00:00 2021-06-18T14:13:03.697479+00:00 0:12:03.046879 42750 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T14:00:58.346341+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-18T13:00:00+00:00 EmrJobFlowSensor 2021-06-18T14:00:48.410201+00:00 2021-06-18T14:10:51.188553+00:00 0:10:02.778352 42749 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T14:00:46.262132+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T14:00:38.535678+00:00 2021-06-18T14:00:40.302886+00:00 0:00:01.767208 42748 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T14:00:36.249024+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T14:00:26.590095+00:00 2021-06-18T14:00:28.425004+00:00 0:00:01.834909 42747 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-18T14:00:24.237894+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-18T13:00:00+00:00 PythonOperator 2021-06-18T14:00:18.412181+00:00 2021-06-18T14:00:22.116897+00:00 0:00:03.704716 42746 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T14:00:16.231380+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-18T13:00:00+00:00 PythonOperator 2021-06-18T14:00:06.434195+00:00 2021-06-18T14:00:09.735118+00:00 0:00:03.300923 42745 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-18T14:00:04.222353+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-18T12:00:00+00:00 EmrJobFlowSensor 2021-06-18T13:21:40.438807+00:00 2021-06-18T13:31:43.253850+00:00 0:10:02.815043 42744 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T13:21:38.208772+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-18T12:00:00+00:00 EmrJobFlowSensor 2021-06-18T13:21:38.440552+00:00 2021-06-18T13:30:41.128737+00:00 0:09:02.688185 42743 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T13:21:36.206054+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-18T12:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T13:21:18.581044+00:00 2021-06-18T13:21:20.399957+00:00 0:00:01.818913 42742 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T13:21:16.255584+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-18T12:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T13:21:16.594926+00:00 2021-06-18T13:21:18.329023+00:00 0:00:01.734097 42741 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T13:21:14.250704+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-18T12:00:00+00:00 PythonOperator 2021-06-18T13:20:58.764469+00:00 2021-06-18T13:21:02.846170+00:00 0:00:04.081701 42740 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T13:20:56.187160+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-18T12:00:00+00:00 PythonOperator 2021-06-18T13:20:56.396777+00:00 2021-06-18T13:21:00.331768+00:00 0:00:03.934991 42739 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T13:20:54.164779+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-18T12:00:00+00:00 TriggerDagRunOperator 2021-06-18T13:20:44.501386+00:00 2021-06-18T13:20:45.097969+00:00 0:00:00.596583 42738 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T13:20:42.153726+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-18T12:00:00+00:00 TriggerDagRunOperator 2021-06-18T13:20:44.361764+00:00 2021-06-18T13:20:44.743556+00:00 0:00:00.381792 42737 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T13:20:42.153760+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-18T12:00:00+00:00 EmrJobFlowSensor 2021-06-18T13:10:11.859741+00:00 2021-06-18T13:20:14.677771+00:00 0:10:02.818030 42736 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-18T13:10:09.358756+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-18T12:05:00+00:00 EmrJobFlowSensor 2021-06-18T13:10:11.739716+00:00 2021-06-18T13:19:14.488694+00:00 0:09:02.748978 42735 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T13:10:09.358713+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-18T12:00:00+00:00 EmrJobFlowSensor 2021-06-18T13:10:07.462338+00:00 2021-06-18T13:22:10.736393+00:00 0:12:03.274055 42734 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-18T13:10:05.285885+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-18T12:05:00+00:00 EmrCreateJobFlowOperator 2021-06-18T13:09:51.453276+00:00 2021-06-18T13:09:53.244263+00:00 0:00:01.790987 42733 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T13:09:49.259155+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-18T12:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T13:09:49.537609+00:00 2021-06-18T13:09:51.284752+00:00 0:00:01.747143 42732 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-18T13:09:47.289335+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-18T12:00:00+00:00 EmrCreateJobFlowOperator 2021-06-18T13:09:45.408055+00:00 2021-06-18T13:09:47.170006+00:00 0:00:01.761951 42731 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-18T13:09:43.227760+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-18T12:00:00+00:00 PythonOperator 2021-06-18T13:09:29.539745+00:00 2021-06-18T13:09:32.817207+00:00 0:00:03.277462 42730 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-18T13:09:27.209038+00:00 2 default_pool