The scheduler does not appear to be running. Last heartbeat was received .

The DAGs list may not update, and new tasks will not be scheduled.

Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-18T18:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T19:00:43.161457+00:00 2021-07-18T19:00:45.467321+00:00 0:00:02.305864 55301 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-18T19:00:40.720843+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-18T18:00:00+00:00 PythonOperator 2021-07-18T19:00:23.229267+00:00 2021-07-18T19:00:27.062217+00:00 0:00:03.832950 55300 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T19:00:20.769015+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-18T18:00:00+00:00 PythonOperator 2021-07-18T19:00:19.489891+00:00 2021-07-18T19:00:23.337814+00:00 0:00:03.847923 55299 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-18T19:00:16.769216+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-18T17:00:00+00:00 EmrJobFlowSensor 2021-07-18T18:12:12.422013+00:00 2021-07-18T18:21:15.058865+00:00 0:09:02.636852 55297 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T18:12:10.193063+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-18T17:00:00+00:00 EmrJobFlowSensor 2021-07-18T18:12:02.724698+00:00 2021-07-18T18:20:05.686441+00:00 0:08:02.961743 55296 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T18:12:00.349395+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T18:11:50.289211+00:00 2021-07-18T18:11:51.951326+00:00 0:00:01.662115 55295 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T18:11:48.148727+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T18:11:40.284494+00:00 2021-07-18T18:11:41.962733+00:00 0:00:01.678239 55294 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T18:11:38.140480+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-18T17:00:00+00:00 PythonOperator 2021-07-18T18:11:30.602807+00:00 2021-07-18T18:11:34.365808+00:00 0:00:03.763001 55293 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T18:11:28.177573+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-18T17:00:00+00:00 PythonOperator 2021-07-18T18:11:20.381429+00:00 2021-07-18T18:11:24.191715+00:00 0:00:03.810286 55292 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T18:11:18.123353+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-18T17:00:00+00:00 TriggerDagRunOperator 2021-07-18T18:11:10.680949+00:00 2021-07-18T18:11:11.192775+00:00 0:00:00.511826 55291 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T18:11:08.173476+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-18T17:00:00+00:00 TriggerDagRunOperator 2021-07-18T18:11:10.579096+00:00 2021-07-18T18:11:10.982914+00:00 0:00:00.403818 55290 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T18:11:08.173444+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-18T17:05:00+00:00 EmrJobFlowSensor 2021-07-18T18:06:05.910487+00:00 2021-07-18T18:15:08.732201+00:00 0:09:02.821714 55289 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T18:06:03.645394+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-18T17:05:00+00:00 EmrCreateJobFlowOperator 2021-07-18T18:05:44.101450+00:00 2021-07-18T18:05:45.744202+00:00 0:00:01.642752 55288 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T18:05:41.672579+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-18T17:05:00+00:00 PythonOperator 2021-07-18T18:05:21.897684+00:00 2021-07-18T18:05:25.355869+00:00 0:00:03.458185 55287 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T18:05:19.607487+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-18T17:00:00+00:00 EmrJobFlowSensor 2021-07-18T18:01:01.345740+00:00 2021-07-18T18:15:04.891417+00:00 0:14:03.545677 55286 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T18:00:59.062940+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-18T17:00:00+00:00 EmrJobFlowSensor 2021-07-18T18:00:55.453346+00:00 2021-07-18T18:10:58.250814+00:00 0:10:02.797468 55285 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T18:00:53.043694+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T18:00:39.429087+00:00 2021-07-18T18:00:41.245650+00:00 0:00:01.816563 55284 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T18:00:36.986294+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-18T17:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T18:00:35.276118+00:00 2021-07-18T18:00:37.069947+00:00 0:00:01.793829 55283 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-18T18:00:32.986051+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-18T17:00:00+00:00 PythonOperator 2021-07-18T18:00:19.106894+00:00 2021-07-18T18:00:23.276508+00:00 0:00:04.169614 55282 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T18:00:16.913578+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-18T17:00:00+00:00 PythonOperator 2021-07-18T18:00:13.262194+00:00 2021-07-18T18:00:16.851389+00:00 0:00:03.589195 55281 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-18T18:00:10.904422+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-18T16:00:00+00:00 EmrJobFlowSensor 2021-07-18T17:12:25.770201+00:00 2021-07-18T17:22:28.935678+00:00 0:10:03.165477 55279 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T17:12:23.345757+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-18T16:00:00+00:00 EmrJobFlowSensor 2021-07-18T17:12:19.653281+00:00 2021-07-18T17:21:22.599166+00:00 0:09:02.945885 55278 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T17:12:17.344374+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T17:12:03.503800+00:00 2021-07-18T17:12:05.230839+00:00 0:00:01.727039 55277 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T17:12:01.244289+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T17:11:59.708096+00:00 2021-07-18T17:12:01.428694+00:00 0:00:01.720598 55276 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T17:11:57.266538+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-18T16:00:00+00:00 PythonOperator 2021-07-18T17:11:42.519206+00:00 2021-07-18T17:11:46.850469+00:00 0:00:04.331263 55275 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T17:11:39.187962+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-18T16:00:00+00:00 PythonOperator 2021-07-18T17:11:37.843847+00:00 2021-07-18T17:11:43.012556+00:00 0:00:05.168709 55274 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T17:11:35.187383+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-18T16:00:00+00:00 TriggerDagRunOperator 2021-07-18T17:11:29.656626+00:00 2021-07-18T17:11:30.169632+00:00 0:00:00.513006 55273 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T17:11:27.156835+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-18T16:00:00+00:00 TriggerDagRunOperator 2021-07-18T17:11:29.388203+00:00 2021-07-18T17:11:29.834188+00:00 0:00:00.445985 55272 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T17:11:27.156802+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-18T16:05:00+00:00 EmrJobFlowSensor 2021-07-18T17:05:48.849425+00:00 2021-07-18T17:14:51.594785+00:00 0:09:02.745360 55271 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T17:05:46.611636+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-18T16:05:00+00:00 EmrCreateJobFlowOperator 2021-07-18T17:05:26.727856+00:00 2021-07-18T17:05:28.411187+00:00 0:00:01.683331 55270 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T17:05:24.582642+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-18T16:05:00+00:00 PythonOperator 2021-07-18T17:05:06.734164+00:00 2021-07-18T17:05:10.512951+00:00 0:00:03.778787 55269 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T17:05:04.520882+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-18T16:00:00+00:00 EmrJobFlowSensor 2021-07-18T17:01:16.600813+00:00 2021-07-18T17:15:20.114998+00:00 0:14:03.514185 55268 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T17:01:14.184294+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-18T16:00:00+00:00 EmrJobFlowSensor 2021-07-18T17:01:08.819256+00:00 2021-07-18T17:11:11.920139+00:00 0:10:03.100883 55267 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T17:01:06.175494+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T17:00:54.721283+00:00 2021-07-18T17:00:56.451323+00:00 0:00:01.730040 55266 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T17:00:52.162161+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-18T16:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T17:00:46.424362+00:00 2021-07-18T17:00:48.103229+00:00 0:00:01.678867 55265 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-18T17:00:44.128674+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-18T16:00:00+00:00 PythonOperator 2021-07-18T17:00:30.345494+00:00 2021-07-18T17:00:34.537081+00:00 0:00:04.191587 55264 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T17:00:28.148786+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-18T16:00:00+00:00 PythonOperator 2021-07-18T17:00:12.588688+00:00 2021-07-18T17:00:16.402325+00:00 0:00:03.813637 55263 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-18T17:00:10.093050+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-18T15:00:00+00:00 EmrJobFlowSensor 2021-07-18T16:11:07.641179+00:00 2021-07-18T16:20:10.211203+00:00 0:09:02.570024 55261 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T16:11:04.537763+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-18T15:00:00+00:00 EmrJobFlowSensor 2021-07-18T16:11:05.405227+00:00 2021-07-18T16:21:08.769125+00:00 0:10:03.363898 55260 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T16:11:02.538835+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T16:10:42.979534+00:00 2021-07-18T16:10:44.707703+00:00 0:00:01.728169 55259 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T16:10:40.518033+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T16:10:42.937504+00:00 2021-07-18T16:10:44.785312+00:00 0:00:01.847808 55258 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T16:10:40.518080+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-18T15:00:00+00:00 PythonOperator 2021-07-18T16:10:22.993067+00:00 2021-07-18T16:10:26.490462+00:00 0:00:03.497395 55257 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T16:10:20.572085+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-18T15:00:00+00:00 PythonOperator 2021-07-18T16:10:20.676529+00:00 2021-07-18T16:10:25.049441+00:00 0:00:04.372912 55256 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T16:10:18.508077+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-18T15:00:00+00:00 TriggerDagRunOperator 2021-07-18T16:10:16.793206+00:00 2021-07-18T16:10:17.302616+00:00 0:00:00.509410 55255 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T16:10:14.497386+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-18T15:00:00+00:00 TriggerDagRunOperator 2021-07-18T16:10:16.667617+00:00 2021-07-18T16:10:17.115734+00:00 0:00:00.448117 55254 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T16:10:14.497349+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-18T15:05:00+00:00 EmrJobFlowSensor 2021-07-18T16:05:58.081069+00:00 2021-07-18T16:15:00.740651+00:00 0:09:02.659582 55253 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T16:05:55.949062+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-18T15:05:00+00:00 EmrCreateJobFlowOperator 2021-07-18T16:05:38.165019+00:00 2021-07-18T16:05:39.884212+00:00 0:00:01.719193 55252 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T16:05:35.933510+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-18T15:05:00+00:00 PythonOperator 2021-07-18T16:05:14.208241+00:00 2021-07-18T16:05:17.612729+00:00 0:00:03.404488 55251 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T16:05:11.893600+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-18T15:00:00+00:00 EmrJobFlowSensor 2021-07-18T16:01:03.743482+00:00 2021-07-18T16:10:06.481293+00:00 0:09:02.737811 55250 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T16:01:01.389754+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-18T15:00:00+00:00 EmrJobFlowSensor 2021-07-18T16:00:59.728660+00:00 2021-07-18T16:15:03.340382+00:00 0:14:03.611722 55249 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T16:00:57.391082+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T16:00:39.715043+00:00 2021-07-18T16:00:41.534461+00:00 0:00:01.819418 55248 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-18T16:00:37.308796+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-18T15:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T16:00:37.430826+00:00 2021-07-18T16:00:39.177054+00:00 0:00:01.746228 55247 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T16:00:35.302971+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-18T15:00:00+00:00 PythonOperator 2021-07-18T16:00:18.162748+00:00 2021-07-18T16:00:21.915197+00:00 0:00:03.752449 55246 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-18T16:00:15.287377+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-18T15:00:00+00:00 PythonOperator 2021-07-18T16:00:18.120918+00:00 2021-07-18T16:00:22.006020+00:00 0:00:03.885102 55245 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T16:00:15.287405+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-18T14:00:00+00:00 EmrJobFlowSensor 2021-07-18T15:12:11.457383+00:00 2021-07-18T15:22:14.497494+00:00 0:10:03.040111 55243 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T15:12:09.204027+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-18T14:00:00+00:00 EmrJobFlowSensor 2021-07-18T15:12:01.871026+00:00 2021-07-18T15:21:04.721901+00:00 0:09:02.850875 55242 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T15:11:59.254555+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T15:11:49.301223+00:00 2021-07-18T15:11:50.974968+00:00 0:00:01.673745 55241 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T15:11:47.039918+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T15:11:39.598799+00:00 2021-07-18T15:11:41.412442+00:00 0:00:01.813643 55240 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T15:11:37.031080+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-18T14:00:00+00:00 PythonOperator 2021-07-18T15:11:29.370493+00:00 2021-07-18T15:11:33.172641+00:00 0:00:03.802148 55239 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T15:11:27.021864+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-18T14:00:00+00:00 PythonOperator 2021-07-18T15:11:19.186272+00:00 2021-07-18T15:11:23.144099+00:00 0:00:03.957827 55238 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T15:11:17.021930+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-18T14:00:00+00:00 TriggerDagRunOperator 2021-07-18T15:11:09.627049+00:00 2021-07-18T15:11:10.140421+00:00 0:00:00.513372 55237 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T15:11:07.010077+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-18T14:00:00+00:00 TriggerDagRunOperator 2021-07-18T15:11:09.409215+00:00 2021-07-18T15:11:09.793589+00:00 0:00:00.384374 55236 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T15:11:07.010045+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-18T14:05:00+00:00 EmrJobFlowSensor 2021-07-18T15:06:04.583730+00:00 2021-07-18T15:15:07.479176+00:00 0:09:02.895446 55235 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T15:06:02.395011+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-18T14:05:00+00:00 EmrCreateJobFlowOperator 2021-07-18T15:05:42.409777+00:00 2021-07-18T15:05:44.142807+00:00 0:00:01.733030 55234 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T15:05:40.316187+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-18T14:05:00+00:00 PythonOperator 2021-07-18T15:05:20.594508+00:00 2021-07-18T15:05:24.446713+00:00 0:00:03.852205 55233 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T15:05:18.357781+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-18T14:00:00+00:00 EmrJobFlowSensor 2021-07-18T15:01:04.113602+00:00 2021-07-18T15:15:07.971269+00:00 0:14:03.857667 55232 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T15:01:01.940912+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-18T14:00:00+00:00 EmrJobFlowSensor 2021-07-18T15:00:50.216490+00:00 2021-07-18T15:10:53.423586+00:00 0:10:03.207096 55231 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T15:00:47.929201+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T15:00:40.175201+00:00 2021-07-18T15:00:41.857100+00:00 0:00:01.681899 55230 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T15:00:37.977311+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-18T14:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T15:00:28.932031+00:00 2021-07-18T15:00:30.778043+00:00 0:00:01.846012 55229 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-18T15:00:25.912226+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-18T14:00:00+00:00 PythonOperator 2021-07-18T15:00:20.513080+00:00 2021-07-18T15:00:24.529518+00:00 0:00:04.016438 55228 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T15:00:17.967006+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-18T14:00:00+00:00 PythonOperator 2021-07-18T15:00:08.204314+00:00 2021-07-18T15:00:12.028755+00:00 0:00:03.824441 55227 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-18T15:00:05.898680+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-18T13:00:00+00:00 EmrJobFlowSensor 2021-07-18T14:12:43.249225+00:00 2021-07-18T14:21:46.075470+00:00 0:09:02.826245 55225 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T14:12:41.116132+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-18T13:00:00+00:00 EmrJobFlowSensor 2021-07-18T14:12:37.411893+00:00 2021-07-18T14:20:40.252696+00:00 0:08:02.840803 55224 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T14:12:35.114400+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T14:12:05.324586+00:00 2021-07-18T14:12:07.051408+00:00 0:00:01.726822 55223 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T14:12:03.086370+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T14:11:57.480215+00:00 2021-07-18T14:11:59.299785+00:00 0:00:01.819570 55222 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T14:11:55.065305+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-18T13:00:00+00:00 PythonOperator 2021-07-18T14:11:33.201559+00:00 2021-07-18T14:11:37.072248+00:00 0:00:03.870689 55221 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T14:11:31.035195+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-18T13:00:00+00:00 PythonOperator 2021-07-18T14:11:25.494092+00:00 2021-07-18T14:11:29.397129+00:00 0:00:03.903037 55220 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T14:11:23.017351+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-18T13:00:00+00:00 TriggerDagRunOperator 2021-07-18T14:11:15.373782+00:00 2021-07-18T14:11:15.883731+00:00 0:00:00.509949 55219 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T14:11:13.012368+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-18T13:00:00+00:00 TriggerDagRunOperator 2021-07-18T14:11:15.184465+00:00 2021-07-18T14:11:15.582221+00:00 0:00:00.397756 55218 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T14:11:13.012334+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-18T13:05:00+00:00 EmrJobFlowSensor 2021-07-18T14:05:54.977445+00:00 2021-07-18T14:14:57.814610+00:00 0:09:02.837165 55217 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T14:05:52.603591+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-18T13:05:00+00:00 EmrCreateJobFlowOperator 2021-07-18T14:05:32.903237+00:00 2021-07-18T14:05:34.543079+00:00 0:00:01.639842 55216 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T14:05:30.646786+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-18T13:05:00+00:00 PythonOperator 2021-07-18T14:05:10.870273+00:00 2021-07-18T14:05:14.669633+00:00 0:00:03.799360 55215 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T14:05:08.541328+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-18T13:00:00+00:00 EmrJobFlowSensor 2021-07-18T14:00:54.282457+00:00 2021-07-18T14:10:57.213380+00:00 0:10:02.930923 55214 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T14:00:52.099048+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-18T13:00:00+00:00 EmrJobFlowSensor 2021-07-18T14:00:52.329691+00:00 2021-07-18T14:14:56.064322+00:00 0:14:03.734631 55213 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T14:00:50.097556+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T14:00:32.382918+00:00 2021-07-18T14:00:34.074178+00:00 0:00:01.691260 55212 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-18T14:00:30.153098+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-18T13:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T14:00:30.722991+00:00 2021-07-18T14:00:32.566176+00:00 0:00:01.843185 55211 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T14:00:28.149288+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-18T13:00:00+00:00 PythonOperator 2021-07-18T14:00:10.621618+00:00 2021-07-18T14:00:14.135714+00:00 0:00:03.514096 55210 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-18T14:00:08.173391+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-18T13:00:00+00:00 PythonOperator 2021-07-18T14:00:08.545100+00:00 2021-07-18T14:00:12.802614+00:00 0:00:04.257514 55209 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T14:00:05.994310+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-18T12:00:00+00:00 EmrJobFlowSensor 2021-07-18T13:11:16.731751+00:00 2021-07-18T13:20:19.724310+00:00 0:09:02.992559 55207 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T13:11:14.508606+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-18T12:00:00+00:00 EmrJobFlowSensor 2021-07-18T13:11:10.781229+00:00 2021-07-18T13:20:13.481987+00:00 0:09:02.700758 55206 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T13:11:08.504817+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-18T12:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T13:10:52.785304+00:00 2021-07-18T13:10:54.456226+00:00 0:00:01.670922 55205 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T13:10:50.490314+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-18T12:00:00+00:00 EmrCreateJobFlowOperator 2021-07-18T13:10:48.776887+00:00 2021-07-18T13:10:50.521575+00:00 0:00:01.744688 55204 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T13:10:46.541169+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-18T12:00:00+00:00 PythonOperator 2021-07-18T13:10:24.683676+00:00 2021-07-18T13:10:28.695200+00:00 0:00:04.011524 55203 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T13:10:22.451740+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-18T12:00:00+00:00 PythonOperator 2021-07-18T13:10:14.685705+00:00 2021-07-18T13:10:18.240504+00:00 0:00:03.554799 55202 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T13:10:12.460198+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-18T12:00:00+00:00 TriggerDagRunOperator 2021-07-18T13:10:03.597082+00:00 2021-07-18T13:10:04.025289+00:00 0:00:00.428207 55201 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T13:10:00.544091+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-18T12:00:00+00:00 TriggerDagRunOperator 2021-07-18T13:10:03.040473+00:00 2021-07-18T13:10:03.693060+00:00 0:00:00.652587 55200 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T13:10:00.544053+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-18T12:05:00+00:00 EmrJobFlowSensor 2021-07-18T13:05:52.449384+00:00 2021-07-18T13:14:55.172645+00:00 0:09:02.723261 55199 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T13:05:50.092905+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-18T12:05:00+00:00 EmrCreateJobFlowOperator 2021-07-18T13:05:30.566926+00:00 2021-07-18T13:05:32.175935+00:00 0:00:01.609009 55198 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-18T13:05:28.158817+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-18T12:05:00+00:00 PythonOperator 2021-07-18T13:05:10.272666+00:00 2021-07-18T13:05:14.178431+00:00 0:00:03.905765 55197 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-18T13:05:08.054351+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-18T12:00:00+00:00 EmrJobFlowSensor 2021-07-18T13:01:00.148314+00:00 2021-07-18T13:14:03.866058+00:00 0:13:03.717744 55196 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-18T13:00:57.558543+00:00 2 default_pool