The scheduler does not appear to be running. Last heartbeat was received .

The DAGs list may not update, and new tasks will not be scheduled.

Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
success livepop-shuffle-job_v002 create_cluster_and_add_emr_steps 2021-05-26T04:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T05:00:35.924312+00:00 2021-05-26T05:00:37.618278+00:00 0:00:01.693966 32373 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T05:00:33.610779+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-05-26T04:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T05:00:29.807969+00:00 2021-05-26T05:00:31.491742+00:00 0:00:01.683773 32372 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-05-26T05:00:27.601051+00:00 2 default_pool
success livepop-shuffle-job_v002 create_emr_steps 2021-05-26T04:00:00+00:00 PythonOperator 2021-05-26T05:00:13.927250+00:00 2021-05-26T05:00:17.234946+00:00 0:00:03.307696 32371 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T05:00:11.652372+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-05-26T04:00:00+00:00 PythonOperator 2021-05-26T05:00:07.881189+00:00 2021-05-26T05:00:11.117194+00:00 0:00:03.236005 32370 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-05-26T05:00:05.582800+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-05-26T03:00:00+00:00 EmrJobFlowSensor 2021-05-26T04:11:20.860892+00:00 2021-05-26T04:19:23.553762+00:00 0:08:02.692870 32368 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T04:11:18.434524+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-05-26T03:00:00+00:00 EmrJobFlowSensor 2021-05-26T04:11:11.061132+00:00 2021-05-26T04:21:13.864612+00:00 0:10:02.803480 32367 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T04:11:08.453354+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-05-26T03:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T04:10:59.008832+00:00 2021-05-26T04:11:00.804874+00:00 0:00:01.796042 32366 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T04:10:56.472842+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-05-26T03:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T04:10:48.660621+00:00 2021-05-26T04:10:50.454480+00:00 0:00:01.793859 32365 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T04:10:46.400850+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-05-26T03:00:00+00:00 PythonOperator 2021-05-26T04:10:36.848247+00:00 2021-05-26T04:10:40.095390+00:00 0:00:03.247143 32364 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T04:10:34.394320+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-05-26T03:00:00+00:00 PythonOperator 2021-05-26T04:10:29.196412+00:00 2021-05-26T04:10:32.683340+00:00 0:00:03.486928 32363 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T04:10:26.341819+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-05-26T03:00:00+00:00 TriggerDagRunOperator 2021-05-26T04:10:20.732687+00:00 2021-05-26T04:10:21.253862+00:00 0:00:00.521175 32362 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T04:10:18.334192+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-05-26T03:00:00+00:00 TriggerDagRunOperator 2021-05-26T04:10:20.578756+00:00 2021-05-26T04:10:20.990099+00:00 0:00:00.411343 32361 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T04:10:18.334228+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-05-26T03:05:00+00:00 EmrJobFlowSensor 2021-05-26T04:05:46.133851+00:00 2021-05-26T04:14:48.857025+00:00 0:09:02.723174 32360 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T04:05:43.892634+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-05-26T03:05:00+00:00 EmrCreateJobFlowOperator 2021-05-26T04:05:26.433274+00:00 2021-05-26T04:05:28.207047+00:00 0:00:01.773773 32359 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T04:05:23.885743+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-05-26T03:05:00+00:00 PythonOperator 2021-05-26T04:05:04.079172+00:00 2021-05-26T04:05:07.276760+00:00 0:00:03.197588 32358 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T04:05:01.801760+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-05-26T03:00:00+00:00 EmrJobFlowSensor 2021-05-26T04:01:07.683846+00:00 2021-05-26T04:10:10.345133+00:00 0:09:02.661287 32357 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T04:01:05.460646+00:00 2 default_pool
success livepop-shuffle-job_v002 check_cluster_status 2021-05-26T03:00:00+00:00 EmrJobFlowSensor 2021-05-26T04:01:05.924316+00:00 2021-05-26T04:11:08.789844+00:00 0:10:02.865528 32356 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T04:01:03.483929+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-05-26T03:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T04:00:45.916848+00:00 2021-05-26T04:00:47.739648+00:00 0:00:01.822800 32355 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-05-26T04:00:43.398043+00:00 2 default_pool
success livepop-shuffle-job_v002 create_cluster_and_add_emr_steps 2021-05-26T03:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T04:00:43.612639+00:00 2021-05-26T04:00:45.314345+00:00 0:00:01.701706 32354 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T04:00:41.394022+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-05-26T03:00:00+00:00 PythonOperator 2021-05-26T04:00:26.412660+00:00 2021-05-26T04:00:29.682265+00:00 0:00:03.269605 32353 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-05-26T04:00:23.385150+00:00 2 default_pool
success livepop-shuffle-job_v002 create_emr_steps 2021-05-26T03:00:00+00:00 PythonOperator 2021-05-26T04:00:24.094636+00:00 2021-05-26T04:00:27.740737+00:00 0:00:03.646101 32352 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T04:00:21.384146+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-05-26T02:00:00+00:00 EmrJobFlowSensor 2021-05-26T03:11:12.919682+00:00 2021-05-26T03:21:15.690701+00:00 0:10:02.771019 32350 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T03:11:10.690242+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-05-26T02:00:00+00:00 EmrJobFlowSensor 2021-05-26T03:11:08.989287+00:00 2021-05-26T03:21:11.757634+00:00 0:10:02.768347 32349 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T03:11:06.686909+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-05-26T02:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T03:10:52.971850+00:00 2021-05-26T03:10:54.756053+00:00 0:00:01.784203 32348 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T03:10:50.649785+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-05-26T02:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T03:10:48.838444+00:00 2021-05-26T03:10:50.516344+00:00 0:00:01.677900 32347 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T03:10:46.646723+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-05-26T02:00:00+00:00 PythonOperator 2021-05-26T03:10:26.071862+00:00 2021-05-26T03:10:29.666241+00:00 0:00:03.594379 32346 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T03:10:22.661383+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-05-26T02:00:00+00:00 PythonOperator 2021-05-26T03:10:23.426077+00:00 2021-05-26T03:10:27.242531+00:00 0:00:03.816454 32345 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T03:10:20.670530+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-05-26T02:00:00+00:00 TriggerDagRunOperator 2021-05-26T03:10:17.079885+00:00 2021-05-26T03:10:17.527011+00:00 0:00:00.447126 32344 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T03:10:14.666858+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-05-26T02:00:00+00:00 TriggerDagRunOperator 2021-05-26T03:10:17.110023+00:00 2021-05-26T03:10:17.637571+00:00 0:00:00.527548 32343 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T03:10:14.666893+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-05-26T02:05:00+00:00 EmrJobFlowSensor 2021-05-26T03:05:58.344010+00:00 2021-05-26T03:15:00.931499+00:00 0:09:02.587489 32342 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T03:05:56.036763+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-05-26T02:05:00+00:00 EmrCreateJobFlowOperator 2021-05-26T03:05:38.240388+00:00 2021-05-26T03:05:39.988459+00:00 0:00:01.748071 32341 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T03:05:36.020763+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-05-26T02:05:00+00:00 PythonOperator 2021-05-26T03:05:16.354064+00:00 2021-05-26T03:05:19.534583+00:00 0:00:03.180519 32340 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T03:05:14.067357+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-05-26T02:00:00+00:00 EmrJobFlowSensor 2021-05-26T03:01:00.339404+00:00 2021-05-26T03:10:03.063425+00:00 0:09:02.724021 32339 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T03:00:57.753672+00:00 2 default_pool
success livepop-shuffle-job_v002 check_cluster_status 2021-05-26T02:00:00+00:00 EmrJobFlowSensor 2021-05-26T03:00:51.826966+00:00 2021-05-26T03:08:54.256801+00:00 0:08:02.429835 32338 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T03:00:49.641407+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-05-26T02:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T03:00:38.394543+00:00 2021-05-26T03:00:40.132569+00:00 0:00:01.738026 32337 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-05-26T03:00:35.631543+00:00 2 default_pool
success livepop-shuffle-job_v002 create_cluster_and_add_emr_steps 2021-05-26T02:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T03:00:30.028590+00:00 2021-05-26T03:00:31.714623+00:00 0:00:01.686033 32336 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T03:00:27.657368+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-05-26T02:00:00+00:00 PythonOperator 2021-05-26T03:00:17.769910+00:00 2021-05-26T03:00:21.054701+00:00 0:00:03.284791 32335 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-05-26T03:00:15.516304+00:00 2 default_pool
success livepop-shuffle-job_v002 create_emr_steps 2021-05-26T02:00:00+00:00 PythonOperator 2021-05-26T03:00:07.780913+00:00 2021-05-26T03:00:10.937237+00:00 0:00:03.156324 32334 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T03:00:05.504669+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-05-26T01:00:00+00:00 EmrJobFlowSensor 2021-05-26T02:12:32.771493+00:00 2021-05-26T02:21:35.288509+00:00 0:09:02.517016 32333 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T02:12:30.606236+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-05-26T01:00:00+00:00 EmrJobFlowSensor 2021-05-26T02:12:21.080747+00:00 2021-05-26T02:21:23.961117+00:00 0:09:02.880370 32332 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T02:12:18.663127+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-05-26T01:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T02:12:08.913945+00:00 2021-05-26T02:12:10.602731+00:00 0:00:01.688786 32331 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T02:12:06.586460+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-05-26T01:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T02:11:58.840463+00:00 2021-05-26T02:12:00.644135+00:00 0:00:01.803672 32330 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T02:11:56.587360+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-05-26T01:00:00+00:00 PythonOperator 2021-05-26T02:11:48.740977+00:00 2021-05-26T02:11:51.988512+00:00 0:00:03.247535 32329 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T02:11:46.541871+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-05-26T01:00:00+00:00 PythonOperator 2021-05-26T02:11:39.489198+00:00 2021-05-26T02:11:42.859332+00:00 0:00:03.370134 32328 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T02:11:36.534607+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-05-26T01:00:00+00:00 TriggerDagRunOperator 2021-05-26T02:11:31.032603+00:00 2021-05-26T02:11:31.556958+00:00 0:00:00.524355 32327 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T02:11:28.525568+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-05-26T01:00:00+00:00 TriggerDagRunOperator 2021-05-26T02:11:30.860898+00:00 2021-05-26T02:11:31.287311+00:00 0:00:00.426413 32326 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T02:11:28.525524+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-05-26T01:05:00+00:00 EmrJobFlowSensor 2021-05-26T02:05:48.646494+00:00 2021-05-26T02:14:51.249935+00:00 0:09:02.603441 32324 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T02:05:46.244076+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-05-26T01:05:00+00:00 EmrCreateJobFlowOperator 2021-05-26T02:05:28.426561+00:00 2021-05-26T02:05:30.063505+00:00 0:00:01.636944 32323 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T02:05:26.193857+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-05-26T01:05:00+00:00 PythonOperator 2021-05-26T02:05:06.386924+00:00 2021-05-26T02:05:09.490663+00:00 0:00:03.103739 32322 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T02:05:04.174227+00:00 2 default_pool
success livepop-shuffle-job_v002 check_cluster_status 2021-05-26T01:00:00+00:00 EmrJobFlowSensor 2021-05-26T02:01:04.408853+00:00 2021-05-26T02:09:06.951291+00:00 0:08:02.542438 32321 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T02:01:01.907114+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-05-26T01:00:00+00:00 EmrJobFlowSensor 2021-05-26T02:00:52.769206+00:00 2021-05-26T02:10:55.464591+00:00 0:10:02.695385 32320 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T02:00:49.894068+00:00 2 default_pool
success livepop-shuffle-job_v002 create_cluster_and_add_emr_steps 2021-05-26T01:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T02:00:44.159286+00:00 2021-05-26T02:00:45.963787+00:00 0:00:01.804501 32319 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T02:00:41.885559+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-05-26T01:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T02:00:30.307343+00:00 2021-05-26T02:00:32.111552+00:00 0:00:01.804209 32318 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-05-26T02:00:27.874446+00:00 2 default_pool
success livepop-shuffle-job_v002 create_emr_steps 2021-05-26T01:00:00+00:00 PythonOperator 2021-05-26T02:00:22.021626+00:00 2021-05-26T02:00:25.227008+00:00 0:00:03.205382 32317 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T02:00:19.868331+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-05-26T01:00:00+00:00 PythonOperator 2021-05-26T02:00:08.259984+00:00 2021-05-26T02:00:11.435562+00:00 0:00:03.175578 32316 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-05-26T02:00:05.845538+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-05-26T00:00:00+00:00 EmrJobFlowSensor 2021-05-26T01:10:09.190925+00:00 2021-05-26T01:18:11.938860+00:00 0:08:02.747935 32315 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T01:10:06.757865+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-05-26T00:00:00+00:00 EmrJobFlowSensor 2021-05-26T01:09:48.881113+00:00 2021-05-26T01:18:51.506663+00:00 0:09:02.625550 32314 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T01:09:46.619826+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-05-26T00:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T01:09:44.733782+00:00 2021-05-26T01:09:46.482624+00:00 0:00:01.748842 32313 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T01:09:42.617681+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-05-26T00:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T01:09:29.077616+00:00 2021-05-26T01:09:30.885145+00:00 0:00:01.807529 32312 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T01:09:26.603813+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-05-26T00:00:00+00:00 PythonOperator 2021-05-26T01:09:24.734821+00:00 2021-05-26T01:09:27.952507+00:00 0:00:03.217686 32311 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T01:09:22.598065+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-05-26T00:05:00+00:00 EmrJobFlowSensor 2021-05-26T01:09:22.966588+00:00 2021-05-26T01:20:25.908299+00:00 0:11:02.941711 32310 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T01:09:20.598390+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-05-26T00:00:00+00:00 PythonOperator 2021-05-26T01:09:06.700040+00:00 2021-05-26T01:09:10.160876+00:00 0:00:03.460836 32309 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T01:09:04.584366+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-05-26T00:00:00+00:00 TriggerDagRunOperator 2021-05-26T01:09:03.566172+00:00 2021-05-26T01:09:04.255662+00:00 0:00:00.689490 32308 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T01:08:58.469615+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-05-26T00:05:00+00:00 EmrCreateJobFlowOperator 2021-05-26T01:09:03.322237+00:00 2021-05-26T01:09:05.277011+00:00 0:00:01.954774 32307 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T01:08:58.469574+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-05-26T00:00:00+00:00 TriggerDagRunOperator 2021-05-26T01:09:01.677002+00:00 2021-05-26T01:09:02.076930+00:00 0:00:00.399928 32306 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T01:08:58.469630+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-05-26T00:05:00+00:00 PythonOperator 2021-05-26T01:08:40.548793+00:00 2021-05-26T01:08:43.777816+00:00 0:00:03.229023 32305 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T01:08:38.269655+00:00 2 default_pool
success livepop-shuffle-job_v002 check_cluster_status 2021-05-26T00:00:00+00:00 EmrJobFlowSensor 2021-05-26T01:00:59.322702+00:00 2021-05-26T01:10:01.964666+00:00 0:09:02.641964 32303 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T01:00:57.071583+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-05-26T00:00:00+00:00 EmrJobFlowSensor 2021-05-26T01:00:51.195537+00:00 2021-05-26T01:08:53.664774+00:00 0:08:02.469237 32302 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T01:00:49.059568+00:00 2 default_pool
success livepop-shuffle-job_v002 create_cluster_and_add_emr_steps 2021-05-26T00:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T01:00:39.279894+00:00 2021-05-26T01:00:41.008982+00:00 0:00:01.729088 32301 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T01:00:37.047966+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-05-26T00:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T01:00:29.354126+00:00 2021-05-26T01:00:31.128118+00:00 0:00:01.773992 32300 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-05-26T01:00:27.038182+00:00 2 default_pool
success livepop-shuffle-job_v002 create_emr_steps 2021-05-26T00:00:00+00:00 PythonOperator 2021-05-26T01:00:17.480128+00:00 2021-05-26T01:00:20.618642+00:00 0:00:03.138514 32299 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T01:00:15.162756+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-05-26T00:00:00+00:00 PythonOperator 2021-05-26T01:00:07.214547+00:00 2021-05-26T01:00:10.462961+00:00 0:00:03.248414 32298 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-05-26T01:00:05.013192+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-05-25T23:00:00+00:00 EmrJobFlowSensor 2021-05-26T00:10:06.202282+00:00 2021-05-26T00:19:08.981708+00:00 0:09:02.779426 32297 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T00:10:03.865692+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-05-25T23:00:00+00:00 EmrJobFlowSensor 2021-05-26T00:09:53.900131+00:00 2021-05-26T00:17:56.329042+00:00 0:08:02.428911 32296 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T00:09:51.734274+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-05-25T23:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T00:09:44.013083+00:00 2021-05-26T00:09:45.683222+00:00 0:00:01.670139 32295 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T00:09:41.723060+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-05-25T23:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T00:09:34.103944+00:00 2021-05-26T00:09:35.902988+00:00 0:00:01.799044 32294 airflow-worker-2.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T00:09:31.714583+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-05-25T23:00:00+00:00 PythonOperator 2021-05-26T00:09:22.450107+00:00 2021-05-26T00:09:25.754917+00:00 0:00:03.304810 32293 airflow-worker-2.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T00:09:19.767033+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-05-25T23:00:00+00:00 PythonOperator 2021-05-26T00:09:12.282828+00:00 2021-05-26T00:09:15.455145+00:00 0:00:03.172317 32292 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T00:09:09.694585+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-05-25T23:00:00+00:00 TriggerDagRunOperator 2021-05-26T00:09:06.626415+00:00 2021-05-26T00:09:07.192062+00:00 0:00:00.565647 32291 airflow-worker-2.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T00:09:03.763810+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-05-25T23:00:00+00:00 TriggerDagRunOperator 2021-05-26T00:09:06.394622+00:00 2021-05-26T00:09:06.899572+00:00 0:00:00.504950 32290 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T00:09:03.763766+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-05-25T23:05:00+00:00 EmrJobFlowSensor 2021-05-26T00:06:01.765718+00:00 2021-05-26T00:14:04.248715+00:00 0:08:02.482997 32289 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T00:05:59.392393+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-05-25T23:05:00+00:00 EmrCreateJobFlowOperator 2021-05-26T00:05:39.780522+00:00 2021-05-26T00:05:41.505264+00:00 0:00:01.724742 32288 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T00:05:37.342646+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-05-25T23:05:00+00:00 PythonOperator 2021-05-26T00:05:18.171624+00:00 2021-05-26T00:05:21.300429+00:00 0:00:03.128805 32287 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T00:05:15.328797+00:00 2 default_pool
success livepop-shuffle-job_v002 check_cluster_status 2021-05-25T23:00:00+00:00 EmrJobFlowSensor 2021-05-26T00:01:03.950845+00:00 2021-05-26T00:11:06.685760+00:00 0:10:02.734915 32285 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-26T00:01:01.763712+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-05-25T23:00:00+00:00 EmrJobFlowSensor 2021-05-26T00:01:00.434645+00:00 2021-05-26T00:09:03.135691+00:00 0:08:02.701046 32284 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T00:00:57.776175+00:00 2 default_pool
success livepop-shuffle-job_v002 create_cluster_and_add_emr_steps 2021-05-25T23:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T00:00:40.668200+00:00 2021-05-26T00:00:42.410973+00:00 0:00:01.742773 32283 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-26T00:00:37.760398+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-05-25T23:00:00+00:00 EmrCreateJobFlowOperator 2021-05-26T00:00:38.163139+00:00 2021-05-26T00:00:40.407263+00:00 0:00:02.244124 32282 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-05-26T00:00:35.764417+00:00 2 default_pool
success livepop-shuffle-job_v002 create_emr_steps 2021-05-25T23:00:00+00:00 PythonOperator 2021-05-26T00:00:18.666970+00:00 2021-05-26T00:00:22.342557+00:00 0:00:03.675587 32281 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-26T00:00:15.621505+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-05-25T23:00:00+00:00 PythonOperator 2021-05-26T00:00:14.230620+00:00 2021-05-26T00:00:18.344644+00:00 0:00:04.114024 32280 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-05-26T00:00:11.679341+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-05-25T22:00:00+00:00 EmrJobFlowSensor 2021-05-25T23:12:11.433746+00:00 2021-05-25T23:22:14.419496+00:00 0:10:02.985750 32279 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-25T23:12:09.139596+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-05-25T22:00:00+00:00 EmrJobFlowSensor 2021-05-25T23:11:59.630417+00:00 2021-05-25T23:22:02.539174+00:00 0:10:02.908757 32278 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-25T23:11:57.138129+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-05-25T22:00:00+00:00 EmrCreateJobFlowOperator 2021-05-25T23:11:49.502144+00:00 2021-05-25T23:11:51.196963+00:00 0:00:01.694819 32277 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-25T23:11:47.241696+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-05-25T22:00:00+00:00 EmrCreateJobFlowOperator 2021-05-25T23:11:37.604982+00:00 2021-05-25T23:11:39.328311+00:00 0:00:01.723329 32276 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-25T23:11:35.176635+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-05-25T22:00:00+00:00 PythonOperator 2021-05-25T23:11:27.671043+00:00 2021-05-25T23:11:31.131069+00:00 0:00:03.460026 32275 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-25T23:11:25.080148+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-05-25T22:00:00+00:00 PythonOperator 2021-05-25T23:11:17.902541+00:00 2021-05-25T23:11:21.177853+00:00 0:00:03.275312 32274 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-25T23:11:15.025783+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-05-25T22:00:00+00:00 TriggerDagRunOperator 2021-05-25T23:11:09.632630+00:00 2021-05-25T23:11:10.146215+00:00 0:00:00.513585 32273 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-25T23:11:07.072714+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-05-25T22:00:00+00:00 TriggerDagRunOperator 2021-05-25T23:11:09.533978+00:00 2021-05-25T23:11:09.987136+00:00 0:00:00.453158 32272 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-25T23:11:07.072680+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-05-25T22:05:00+00:00 EmrJobFlowSensor 2021-05-25T23:05:56.881545+00:00 2021-05-25T23:14:59.414041+00:00 0:09:02.532496 32271 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-05-25T23:05:54.561172+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-05-25T22:05:00+00:00 EmrCreateJobFlowOperator 2021-05-25T23:05:34.884445+00:00 2021-05-25T23:05:36.532624+00:00 0:00:01.648179 32270 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-05-25T23:05:32.469787+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-05-25T22:05:00+00:00 PythonOperator 2021-05-25T23:05:12.871050+00:00 2021-05-25T23:05:16.065177+00:00 0:00:03.194127 32269 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-05-25T23:05:10.457918+00:00 2 default_pool