Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-09T00:00:00+00:00 TriggerDagRunOperator 2021-07-09T01:10:11.400258+00:00 2021-07-09T01:10:11.794871+00:00 0:00:00.394613 51685 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T01:10:08.895146+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-09T00:00:00+00:00 TriggerDagRunOperator 2021-07-09T01:10:11.156983+00:00 2021-07-09T01:10:11.653595+00:00 0:00:00.496612 51684 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T01:10:08.895113+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-09T00:05:00+00:00 EmrJobFlowSensor 2021-07-09T01:05:52.789167+00:00 2021-07-09T01:13:55.363542+00:00 0:08:02.574375 51683 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T01:05:50.330643+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-09T00:05:00+00:00 EmrCreateJobFlowOperator 2021-07-09T01:05:30.539149+00:00 2021-07-09T01:05:32.171682+00:00 0:00:01.632533 51682 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-09T01:05:28.307579+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-09T00:05:00+00:00 PythonOperator 2021-07-09T01:05:08.617150+00:00 2021-07-09T01:05:11.962699+00:00 0:00:03.345549 51681 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-09T01:05:06.297918+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-09T00:00:00+00:00 EmrJobFlowSensor 2021-07-09T01:01:00.425943+00:00 2021-07-09T01:10:02.994168+00:00 0:09:02.568225 51680 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-09T01:00:57.960647+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-09T00:00:00+00:00 EmrCreateJobFlowOperator 2021-07-09T01:00:38.273228+00:00 2021-07-09T01:00:40.087838+00:00 0:00:01.814610 51678 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-09T01:00:35.887594+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-09T00:00:00+00:00 PythonOperator 2021-07-09T01:00:18.242362+00:00 2021-07-09T01:00:21.687566+00:00 0:00:03.445204 51676 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-09T01:00:15.826799+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-08T23:00:00+00:00 EmrJobFlowSensor 2021-07-09T00:11:08.572629+00:00 2021-07-09T00:21:11.502979+00:00 0:10:02.930350 51674 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T00:11:06.316181+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-08T23:00:00+00:00 EmrJobFlowSensor 2021-07-09T00:10:56.811551+00:00 2021-07-09T00:18:59.450799+00:00 0:08:02.639248 51673 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T00:10:54.303005+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-08T23:00:00+00:00 EmrCreateJobFlowOperator 2021-07-09T00:10:48.409674+00:00 2021-07-09T00:10:50.093047+00:00 0:00:01.683373 51672 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-09T00:10:46.297788+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-08T23:00:00+00:00 EmrCreateJobFlowOperator 2021-07-09T00:10:35.151275+00:00 2021-07-09T00:10:36.828640+00:00 0:00:01.677365 51671 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-09T00:10:32.341179+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-08T23:00:00+00:00 PythonOperator 2021-07-09T00:10:26.573303+00:00 2021-07-09T00:10:30.510330+00:00 0:00:03.937027 51670 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-09T00:10:24.354188+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-08T23:00:00+00:00 PythonOperator 2021-07-09T00:10:13.189689+00:00 2021-07-09T00:10:16.882617+00:00 0:00:03.692928 51669 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-09T00:10:10.270511+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-08T23:00:00+00:00 TriggerDagRunOperator 2021-07-09T00:10:04.904729+00:00 2021-07-09T00:10:05.396236+00:00 0:00:00.491507 51668 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T00:10:02.276069+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-08T23:00:00+00:00 TriggerDagRunOperator 2021-07-09T00:10:04.586054+00:00 2021-07-09T00:10:05.036900+00:00 0:00:00.450846 51667 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T00:10:02.276039+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-08T23:05:00+00:00 EmrJobFlowSensor 2021-07-09T00:05:56.066047+00:00 2021-07-09T00:14:58.691524+00:00 0:09:02.625477 51666 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-09T00:05:53.857712+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-08T23:05:00+00:00 EmrCreateJobFlowOperator 2021-07-09T00:05:34.154929+00:00 2021-07-09T00:05:35.913462+00:00 0:00:01.758533 51665 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-09T00:05:31.719935+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-08T23:05:00+00:00 PythonOperator 2021-07-09T00:05:14.036917+00:00 2021-07-09T00:05:17.748141+00:00 0:00:03.711224 51664 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-09T00:05:11.700626+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-08T23:00:00+00:00 EmrJobFlowSensor 2021-07-09T00:00:57.424153+00:00 2021-07-09T00:10:00.259008+00:00 0:09:02.834855 51663 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-09T00:00:55.160498+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-08T23:00:00+00:00 EmrCreateJobFlowOperator 2021-07-09T00:00:41.698591+00:00 2021-07-09T00:00:43.698895+00:00 0:00:02.000304 51662 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-09T00:00:39.152391+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-08T23:00:00+00:00 EmrCreateJobFlowOperator 2021-07-09T00:00:35.731871+00:00 2021-07-09T00:00:37.559871+00:00 0:00:01.828000 51661 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-09T00:00:33.067784+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-08T23:00:00+00:00 PythonOperator 2021-07-09T00:00:20.323060+00:00 2021-07-09T00:00:24.279486+00:00 0:00:03.956426 51660 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-09T00:00:16.973902+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-08T23:00:00+00:00 PythonOperator 2021-07-09T00:00:15.247020+00:00 2021-07-09T00:00:20.147814+00:00 0:00:04.900794 51659 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-09T00:00:12.962750+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-08T22:00:00+00:00 EmrJobFlowSensor 2021-07-08T23:11:36.109024+00:00 2021-07-08T23:20:38.971919+00:00 0:09:02.862895 51657 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T23:11:33.872844+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-08T22:00:00+00:00 EmrJobFlowSensor 2021-07-08T23:11:30.135442+00:00 2021-07-08T23:19:32.716937+00:00 0:08:02.581495 51656 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T23:11:27.871423+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-08T22:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T23:11:14.038748+00:00 2021-07-08T23:11:15.770018+00:00 0:00:01.731270 51655 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T23:11:11.848176+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-08T22:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T23:11:10.037618+00:00 2021-07-08T23:11:11.757397+00:00 0:00:01.719779 51654 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T23:11:07.844591+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-08T22:00:00+00:00 PythonOperator 2021-07-08T23:10:53.344483+00:00 2021-07-08T23:10:57.293931+00:00 0:00:03.949448 51653 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T23:10:49.827250+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-08T22:00:00+00:00 PythonOperator 2021-07-08T23:10:48.019124+00:00 2021-07-08T23:10:53.114578+00:00 0:00:05.095454 51652 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T23:10:45.829600+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-08T22:00:00+00:00 TriggerDagRunOperator 2021-07-08T23:10:26.371588+00:00 2021-07-08T23:10:26.772061+00:00 0:00:00.400473 51651 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T23:10:23.807175+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-08T22:00:00+00:00 TriggerDagRunOperator 2021-07-08T23:10:26.079668+00:00 2021-07-08T23:10:26.654454+00:00 0:00:00.574786 51650 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T23:10:23.807212+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-08T22:05:00+00:00 EmrJobFlowSensor 2021-07-08T23:05:49.645242+00:00 2021-07-08T23:13:52.201051+00:00 0:08:02.555809 51649 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T23:05:47.432107+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-08T22:05:00+00:00 EmrCreateJobFlowOperator 2021-07-08T23:05:27.758212+00:00 2021-07-08T23:05:29.547183+00:00 0:00:01.788971 51648 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T23:05:25.478523+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-08T22:05:00+00:00 PythonOperator 2021-07-08T23:05:05.655267+00:00 2021-07-08T23:05:09.386927+00:00 0:00:03.731660 51647 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T23:05:03.391027+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-08T22:00:00+00:00 EmrJobFlowSensor 2021-07-08T23:00:59.209730+00:00 2021-07-08T23:10:01.944013+00:00 0:09:02.734283 51646 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T23:00:57.009126+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 check_cluster_status 2021-07-07T23:00:00+00:00 EmrJobFlowSensor 2021-07-08T23:00:47.300952+00:00 2021-07-08T23:09:50.117260+00:00 0:09:02.816308 51645 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T23:00:45.000627+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-08T22:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T23:00:43.867023+00:00 2021-07-08T23:00:45.719027+00:00 0:00:01.852004 51644 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T23:00:41.054990+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-08T22:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T23:00:37.202517+00:00 2021-07-08T23:00:38.982895+00:00 0:00:01.780378 51643 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-08T23:00:34.992244+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 create_cluster_and_add_emr_steps 2021-07-07T23:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T23:00:25.241868+00:00 2021-07-08T23:00:26.902858+00:00 0:00:01.660990 51642 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T23:00:23.043852+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-08T22:00:00+00:00 PythonOperator 2021-07-08T23:00:23.369610+00:00 2021-07-08T23:00:27.351918+00:00 0:00:03.982308 51641 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T23:00:21.044099+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-08T22:00:00+00:00 PythonOperator 2021-07-08T23:00:13.658884+00:00 2021-07-08T23:00:17.421781+00:00 0:00:03.762897 51640 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-08T23:00:10.970915+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 create_emr_steps 2021-07-07T23:00:00+00:00 PythonOperator 2021-07-08T23:00:05.352686+00:00 2021-07-08T23:00:09.184289+00:00 0:00:03.831603 51639 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T23:00:02.965338+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-08T21:00:00+00:00 EmrJobFlowSensor 2021-07-08T22:11:12.542450+00:00 2021-07-08T22:20:15.566942+00:00 0:09:03.024492 51637 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T22:11:10.044843+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-08T21:00:00+00:00 EmrJobFlowSensor 2021-07-08T22:11:12.569905+00:00 2021-07-08T22:20:15.563566+00:00 0:09:02.993661 51636 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T22:11:10.044798+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-08T21:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T22:10:50.319283+00:00 2021-07-08T22:10:52.174666+00:00 0:00:01.855383 51635 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T22:10:47.941648+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-08T21:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T22:10:50.247009+00:00 2021-07-08T22:10:51.935441+00:00 0:00:01.688432 51634 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T22:10:47.941684+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-08T21:00:00+00:00 PythonOperator 2021-07-08T22:10:30.575723+00:00 2021-07-08T22:10:34.364583+00:00 0:00:03.788860 51633 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T22:10:27.962209+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-08T21:00:00+00:00 PythonOperator 2021-07-08T22:10:30.275345+00:00 2021-07-08T22:10:33.987421+00:00 0:00:03.712076 51632 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T22:10:27.962251+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-08T21:00:00+00:00 TriggerDagRunOperator 2021-07-08T22:10:08.367204+00:00 2021-07-08T22:10:08.789371+00:00 0:00:00.422167 51631 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T22:10:05.941168+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-08T21:00:00+00:00 TriggerDagRunOperator 2021-07-08T22:10:08.368044+00:00 2021-07-08T22:10:08.982153+00:00 0:00:00.614109 51630 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T22:10:05.941218+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-08T21:05:00+00:00 EmrJobFlowSensor 2021-07-08T22:06:15.676851+00:00 2021-07-08T22:15:18.514577+00:00 0:09:02.837726 51629 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T22:06:13.397943+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-08T21:05:00+00:00 EmrCreateJobFlowOperator 2021-07-08T22:05:47.563654+00:00 2021-07-08T22:05:49.358938+00:00 0:00:01.795284 51628 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T22:05:45.342615+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-08T21:05:00+00:00 PythonOperator 2021-07-08T22:05:21.422501+00:00 2021-07-08T22:05:25.225705+00:00 0:00:03.803204 51627 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T22:05:19.316514+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-08T21:00:00+00:00 EmrJobFlowSensor 2021-07-08T22:00:55.194521+00:00 2021-07-08T22:09:58.003358+00:00 0:09:02.808837 51625 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T22:00:53.000539+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-08T21:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T22:00:35.347341+00:00 2021-07-08T22:00:37.026276+00:00 0:00:01.678935 51624 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-08T22:00:32.993355+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-08T21:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T22:00:29.510647+00:00 2021-07-08T22:00:31.193877+00:00 0:00:01.683230 51623 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T22:00:27.041483+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-08T21:00:00+00:00 PythonOperator 2021-07-08T22:00:13.844851+00:00 2021-07-08T22:00:17.600561+00:00 0:00:03.755710 51622 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-08T22:00:10.888777+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-08T21:00:00+00:00 PythonOperator 2021-07-08T22:00:07.511864+00:00 2021-07-08T22:00:12.340094+00:00 0:00:04.828230 51621 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T22:00:04.955775+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-08T20:00:00+00:00 EmrJobFlowSensor 2021-07-08T21:10:16.394448+00:00 2021-07-08T21:18:18.962949+00:00 0:08:02.568501 51619 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T21:10:14.164792+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-08T20:00:00+00:00 EmrJobFlowSensor 2021-07-08T21:10:00.511290+00:00 2021-07-08T21:20:03.490655+00:00 0:10:02.979365 51618 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T21:09:58.153910+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-08T20:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T21:09:54.862652+00:00 2021-07-08T21:09:56.619808+00:00 0:00:01.757156 51617 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T21:09:52.146518+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-08T20:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T21:09:40.178367+00:00 2021-07-08T21:09:41.875255+00:00 0:00:01.696888 51616 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T21:09:37.992239+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-08T20:00:00+00:00 PythonOperator 2021-07-08T21:09:34.484528+00:00 2021-07-08T21:09:37.945538+00:00 0:00:03.461010 51615 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T21:09:31.987530+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-08T20:00:00+00:00 PythonOperator 2021-07-08T21:09:18.117408+00:00 2021-07-08T21:09:22.161608+00:00 0:00:04.044200 51614 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T21:09:15.928656+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-08T20:00:00+00:00 TriggerDagRunOperator 2021-07-08T21:09:08.330213+00:00 2021-07-08T21:09:08.847200+00:00 0:00:00.516987 51613 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T21:09:05.929649+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-08T20:00:00+00:00 TriggerDagRunOperator 2021-07-08T21:09:08.176969+00:00 2021-07-08T21:09:08.604181+00:00 0:00:00.427212 51612 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T21:09:05.929682+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-08T20:05:00+00:00 EmrJobFlowSensor 2021-07-08T21:06:16.006756+00:00 2021-07-08T21:14:18.511273+00:00 0:08:02.504517 51611 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T21:06:13.771975+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-08T20:05:00+00:00 EmrCreateJobFlowOperator 2021-07-08T21:05:56.203059+00:00 2021-07-08T21:05:57.935104+00:00 0:00:01.732045 51610 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T21:05:53.767303+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-08T20:05:00+00:00 PythonOperator 2021-07-08T21:05:33.762877+00:00 2021-07-08T21:05:37.460580+00:00 0:00:03.697703 51609 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T21:05:31.639536+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-08T20:00:00+00:00 EmrJobFlowSensor 2021-07-08T21:00:51.278991+00:00 2021-07-08T21:08:53.903200+00:00 0:08:02.624209 51608 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T21:00:49.105421+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-08T20:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T21:00:29.519407+00:00 2021-07-08T21:00:31.319812+00:00 0:00:01.800405 51607 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-08T21:00:26.989814+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-08T20:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T21:00:25.431434+00:00 2021-07-08T21:00:27.357970+00:00 0:00:01.926536 51606 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T21:00:22.976822+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-08T20:00:00+00:00 PythonOperator 2021-07-08T21:00:07.854897+00:00 2021-07-08T21:00:11.776751+00:00 0:00:03.921854 51605 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-08T21:00:04.949714+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-08T20:00:00+00:00 PythonOperator 2021-07-08T21:00:05.662048+00:00 2021-07-08T21:00:10.200708+00:00 0:00:04.538660 51604 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T21:00:02.952796+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-08T19:00:00+00:00 EmrJobFlowSensor 2021-07-08T20:12:25.571075+00:00 2021-07-08T20:22:28.283549+00:00 0:10:02.712474 51602 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T20:12:23.245330+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-08T19:00:00+00:00 EmrJobFlowSensor 2021-07-08T20:12:13.549070+00:00 2021-07-08T20:22:16.719856+00:00 0:10:03.170786 51601 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T20:12:11.208143+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-08T19:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T20:12:05.427203+00:00 2021-07-08T20:12:07.153457+00:00 0:00:01.726254 51600 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T20:12:03.201502+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-08T19:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T20:11:49.470758+00:00 2021-07-08T20:11:51.157762+00:00 0:00:01.687004 51599 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T20:11:47.159364+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-08T19:00:00+00:00 PythonOperator 2021-07-08T20:11:41.478625+00:00 2021-07-08T20:11:45.259523+00:00 0:00:03.780898 51598 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T20:11:39.158763+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-08T19:00:00+00:00 PythonOperator 2021-07-08T20:11:27.353965+00:00 2021-07-08T20:11:31.508359+00:00 0:00:04.154394 51597 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T20:11:25.057536+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-08T19:00:00+00:00 TriggerDagRunOperator 2021-07-08T20:11:23.343051+00:00 2021-07-08T20:11:23.833755+00:00 0:00:00.490704 51596 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T20:11:20.998931+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-08T19:00:00+00:00 TriggerDagRunOperator 2021-07-08T20:11:23.188599+00:00 2021-07-08T20:11:23.566485+00:00 0:00:00.377886 51595 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T20:11:20.998894+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-08T19:05:00+00:00 EmrJobFlowSensor 2021-07-08T20:06:00.720802+00:00 2021-07-08T20:15:03.281248+00:00 0:09:02.560446 51594 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T20:05:58.357885+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-08T19:05:00+00:00 EmrCreateJobFlowOperator 2021-07-08T20:05:40.433833+00:00 2021-07-08T20:05:42.137786+00:00 0:00:01.703953 51593 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T20:05:38.304506+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-08T19:05:00+00:00 PythonOperator 2021-07-08T20:05:18.539517+00:00 2021-07-08T20:05:22.347805+00:00 0:00:03.808288 51592 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T20:05:16.224398+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-08T19:00:00+00:00 EmrJobFlowSensor 2021-07-08T20:01:00.323945+00:00 2021-07-08T20:11:03.423793+00:00 0:10:03.099848 51591 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T20:00:57.864037+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-08T19:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T20:00:46.071793+00:00 2021-07-08T20:00:47.989001+00:00 0:00:01.917208 51590 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T20:00:43.772416+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-08T19:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T20:00:40.152986+00:00 2021-07-08T20:00:42.022403+00:00 0:00:01.869417 51589 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-08T20:00:37.762286+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-08T19:00:00+00:00 PythonOperator 2021-07-08T20:00:18.072009+00:00 2021-07-08T20:00:22.106332+00:00 0:00:04.034323 51588 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T20:00:15.740585+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-08T19:00:00+00:00 PythonOperator 2021-07-08T20:00:12.103117+00:00 2021-07-08T20:00:16.069296+00:00 0:00:03.966179 51587 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-08T20:00:09.735742+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-07-08T18:00:00+00:00 EmrJobFlowSensor 2021-07-08T19:13:16.920856+00:00 2021-07-08T19:23:20.053574+00:00 0:10:03.132718 51585 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T19:13:14.714818+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-07-08T18:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T19:12:54.897588+00:00 2021-07-08T19:12:56.587106+00:00 0:00:01.689518 51584 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T19:12:52.701409+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-07-08T18:00:00+00:00 EmrJobFlowSensor 2021-07-08T19:12:43.168205+00:00 2021-07-08T19:21:45.790205+00:00 0:09:02.622000 51583 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T19:12:40.691473+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-07-08T18:00:00+00:00 PythonOperator 2021-07-08T19:12:33.117304+00:00 2021-07-08T19:12:36.742768+00:00 0:00:03.625464 51582 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T19:12:30.671498+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-07-08T18:00:00+00:00 EmrCreateJobFlowOperator 2021-07-08T19:12:14.863136+00:00 2021-07-08T19:12:16.636057+00:00 0:00:01.772921 51581 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-08T19:12:12.609034+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-07-08T18:00:00+00:00 PythonOperator 2021-07-08T19:11:40.759998+00:00 2021-07-08T19:11:44.383568+00:00 0:00:03.623570 51580 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-08T19:11:38.580163+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-08T18:00:00+00:00 TriggerDagRunOperator 2021-07-08T19:11:11.043455+00:00 2021-07-08T19:11:11.546799+00:00 0:00:00.503344 51579 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T19:11:08.493306+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-08T18:00:00+00:00 TriggerDagRunOperator 2021-07-08T19:11:10.908821+00:00 2021-07-08T19:11:11.328879+00:00 0:00:00.420058 51578 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T19:11:08.493339+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-08T18:05:00+00:00 EmrJobFlowSensor 2021-07-08T19:06:12.329919+00:00 2021-07-08T19:15:15.073676+00:00 0:09:02.743757 51577 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-08T19:06:09.999934+00:00 2 default_pool