Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-01T02:00:00+00:00 TriggerDagRunOperator 2021-07-01T03:11:22.037985+00:00 2021-07-01T03:11:22.417721+00:00 0:00:00.379736 48177 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T03:11:19.826380+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-01T02:05:00+00:00 EmrJobFlowSensor 2021-07-01T03:05:51.597241+00:00 2021-07-01T03:14:54.376520+00:00 0:09:02.779279 48176 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T03:05:49.418138+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-01T02:05:00+00:00 EmrCreateJobFlowOperator 2021-07-01T03:05:27.504011+00:00 2021-07-01T03:05:29.141721+00:00 0:00:01.637710 48175 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T03:05:25.397338+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-01T02:05:00+00:00 PythonOperator 2021-07-01T03:05:05.574631+00:00 2021-07-01T03:05:08.975829+00:00 0:00:03.401198 48174 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T03:05:03.352194+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-01T02:00:00+00:00 EmrJobFlowSensor 2021-07-01T03:00:59.351909+00:00 2021-07-01T03:11:02.372824+00:00 0:10:03.020915 48173 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T03:00:57.005405+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-01T02:00:00+00:00 EmrJobFlowSensor 2021-07-01T03:00:59.219244+00:00 2021-07-01T03:12:02.344528+00:00 0:11:03.125284 48172 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T03:00:57.005433+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-01T02:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T03:00:39.526005+00:00 2021-07-01T03:00:41.234909+00:00 0:00:01.708904 48171 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-01T03:00:36.985763+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-01T02:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T03:00:37.115303+00:00 2021-07-01T03:00:39.195617+00:00 0:00:02.080314 48170 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T03:00:34.983605+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-01T02:00:00+00:00 PythonOperator 2021-07-01T03:00:15.293243+00:00 2021-07-01T03:00:18.802699+00:00 0:00:03.509456 48169 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-01T03:00:12.924759+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-01T02:00:00+00:00 PythonOperator 2021-07-01T03:00:13.308182+00:00 2021-07-01T03:00:17.181385+00:00 0:00:03.873203 48168 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T03:00:10.893894+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-01T01:00:00+00:00 TriggerDagRunOperator 2021-07-01T02:09:00.959322+00:00 2021-07-01T02:09:01.374771+00:00 0:00:00.415449 48166 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T02:08:57.964950+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-01T01:00:00+00:00 TriggerDagRunOperator 2021-07-01T02:09:00.609682+00:00 2021-07-01T02:09:01.141542+00:00 0:00:00.531860 48165 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T02:08:57.964877+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-01T01:05:00+00:00 EmrJobFlowSensor 2021-07-01T02:05:56.055767+00:00 2021-07-01T02:13:58.476568+00:00 0:08:02.420801 48164 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T02:05:53.546426+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-01T01:05:00+00:00 EmrCreateJobFlowOperator 2021-07-01T02:05:33.926330+00:00 2021-07-01T02:05:35.661625+00:00 0:00:01.735295 48163 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T02:05:31.487716+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-01T01:05:00+00:00 PythonOperator 2021-07-01T02:05:09.732439+00:00 2021-07-01T02:05:13.322005+00:00 0:00:03.589566 48162 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T02:05:07.476857+00:00 2 default_pool
success livepop-backup-and-invalid_v002 check_cluster_status 2021-06-30T02:00:00+00:00 EmrJobFlowSensor 2021-07-01T02:01:11.528769+00:00 2021-07-01T02:12:14.442968+00:00 0:11:02.914199 48161 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T02:01:09.050206+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-01T01:00:00+00:00 EmrJobFlowSensor 2021-07-01T02:01:05.421011+00:00 2021-07-01T02:12:08.667633+00:00 0:11:03.246622 48160 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T02:01:03.037084+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-01T01:00:00+00:00 EmrJobFlowSensor 2021-07-01T02:00:50.245943+00:00 2021-07-01T02:08:52.775758+00:00 0:08:02.529815 48159 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T02:00:47.021694+00:00 2 default_pool
success livepop-backup-and-invalid_v002 create_cluster_and_add_emr_steps 2021-06-30T02:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T02:00:47.789456+00:00 2021-07-01T02:00:49.906877+00:00 0:00:02.117421 48158 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T02:00:45.087776+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-01T01:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T02:00:41.298748+00:00 2021-07-01T02:00:43.139055+00:00 0:00:01.840307 48157 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T02:00:39.047152+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-01T01:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T02:00:27.102761+00:00 2021-07-01T02:00:28.872827+00:00 0:00:01.770066 48156 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-01T02:00:25.006913+00:00 2 default_pool
success livepop-backup-and-invalid_v002 create_emr_steps 2021-06-30T02:00:00+00:00 PythonOperator 2021-07-01T02:00:25.580930+00:00 2021-07-01T02:00:29.432089+00:00 0:00:03.851159 48155 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T02:00:23.007974+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-01T01:00:00+00:00 PythonOperator 2021-07-01T02:00:17.091824+00:00 2021-07-01T02:00:20.912511+00:00 0:00:03.820687 48154 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T02:00:14.993603+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-01T01:00:00+00:00 PythonOperator 2021-07-01T02:00:05.241365+00:00 2021-07-01T02:00:09.033067+00:00 0:00:03.791702 48153 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-01T02:00:02.986241+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-07-01T00:00:00+00:00 TriggerDagRunOperator 2021-07-01T01:11:28.269057+00:00 2021-07-01T01:11:28.774157+00:00 0:00:00.505100 48152 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T01:11:25.546661+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-07-01T00:00:00+00:00 TriggerDagRunOperator 2021-07-01T01:11:28.078246+00:00 2021-07-01T01:11:28.476878+00:00 0:00:00.398632 48151 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T01:11:25.546632+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-07-01T00:05:00+00:00 EmrJobFlowSensor 2021-07-01T01:05:55.175699+00:00 2021-07-01T01:15:57.930402+00:00 0:10:02.754703 48149 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T01:05:52.966273+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-07-01T00:05:00+00:00 EmrCreateJobFlowOperator 2021-07-01T01:05:35.236132+00:00 2021-07-01T01:05:36.944535+00:00 0:00:01.708403 48148 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T01:05:32.887282+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-07-01T00:05:00+00:00 PythonOperator 2021-07-01T01:05:13.006553+00:00 2021-07-01T01:05:16.350418+00:00 0:00:03.343865 48147 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T01:05:10.839816+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-07-01T00:00:00+00:00 EmrJobFlowSensor 2021-07-01T01:01:19.105220+00:00 2021-07-01T01:13:22.273187+00:00 0:12:03.167967 48146 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T01:01:16.269316+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-07-01T00:00:00+00:00 EmrJobFlowSensor 2021-07-01T01:01:16.535485+00:00 2021-07-01T01:10:19.907708+00:00 0:09:03.372223 48145 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T01:01:14.203907+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-07-01T00:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T01:00:56.387220+00:00 2021-07-01T01:00:58.145812+00:00 0:00:01.758592 48144 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T01:00:54.185710+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-07-01T00:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T01:00:54.689543+00:00 2021-07-01T01:00:56.503351+00:00 0:00:01.813808 48143 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-01T01:00:52.181462+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-07-01T00:00:00+00:00 PythonOperator 2021-07-01T01:00:34.660309+00:00 2021-07-01T01:00:38.462201+00:00 0:00:03.801892 48142 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T01:00:32.244285+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-07-01T00:00:00+00:00 PythonOperator 2021-07-01T01:00:32.289552+00:00 2021-07-01T01:00:35.969271+00:00 0:00:03.679719 48141 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-01T01:00:30.166502+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-30T23:00:00+00:00 TriggerDagRunOperator 2021-07-01T00:11:23.643675+00:00 2021-07-01T00:11:24.059944+00:00 0:00:00.416269 48140 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T00:11:20.608915+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-30T23:00:00+00:00 TriggerDagRunOperator 2021-07-01T00:11:23.371676+00:00 2021-07-01T00:11:23.925212+00:00 0:00:00.553536 48139 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T00:11:20.608986+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-30T23:05:00+00:00 EmrJobFlowSensor 2021-07-01T00:05:52.046310+00:00 2021-07-01T00:14:54.663359+00:00 0:09:02.617049 48137 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T00:05:49.930051+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-30T23:05:00+00:00 EmrCreateJobFlowOperator 2021-07-01T00:05:30.525410+00:00 2021-07-01T00:05:32.219109+00:00 0:00:01.693699 48136 airflow-worker-3.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T00:05:27.975248+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-30T23:05:00+00:00 PythonOperator 2021-07-01T00:05:08.260348+00:00 2021-07-01T00:05:11.855670+00:00 0:00:03.595322 48135 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T00:05:05.954673+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-30T23:00:00+00:00 EmrJobFlowSensor 2021-07-01T00:01:03.509621+00:00 2021-07-01T00:11:06.335713+00:00 0:10:02.826092 48134 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T00:01:01.351040+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-30T23:00:00+00:00 EmrJobFlowSensor 2021-07-01T00:00:57.482198+00:00 2021-07-01T00:13:00.539710+00:00 0:12:03.057512 48133 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-07-01T00:00:55.339546+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-30T23:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T00:00:41.508506+00:00 2021-07-01T00:00:43.274258+00:00 0:00:01.765752 48132 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-07-01T00:00:39.328464+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-30T23:00:00+00:00 EmrCreateJobFlowOperator 2021-07-01T00:00:35.675056+00:00 2021-07-01T00:00:37.502708+00:00 0:00:01.827652 48131 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-07-01T00:00:33.325886+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-30T23:00:00+00:00 PythonOperator 2021-07-01T00:00:18.821557+00:00 2021-07-01T00:00:22.223430+00:00 0:00:03.401873 48130 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-07-01T00:00:15.367553+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-30T23:00:00+00:00 PythonOperator 2021-07-01T00:00:13.679298+00:00 2021-07-01T00:00:18.581524+00:00 0:00:04.902226 48129 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-07-01T00:00:11.351614+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-30T22:00:00+00:00 TriggerDagRunOperator 2021-06-30T23:11:30.613392+00:00 2021-06-30T23:11:31.190871+00:00 0:00:00.577479 48128 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T23:11:27.862493+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-30T22:00:00+00:00 TriggerDagRunOperator 2021-06-30T23:11:30.534096+00:00 2021-06-30T23:11:30.974173+00:00 0:00:00.440077 48127 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T23:11:27.862522+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-30T22:05:00+00:00 EmrJobFlowSensor 2021-06-30T23:05:55.367571+00:00 2021-06-30T23:14:58.064462+00:00 0:09:02.696891 48125 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T23:05:53.118184+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-30T22:05:00+00:00 EmrCreateJobFlowOperator 2021-06-30T23:05:35.457131+00:00 2021-06-30T23:05:37.103143+00:00 0:00:01.646012 48124 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T23:05:33.102966+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-30T22:05:00+00:00 PythonOperator 2021-06-30T23:05:13.205045+00:00 2021-06-30T23:05:16.764730+00:00 0:00:03.559685 48123 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T23:05:11.086191+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 check_cluster_status 2021-06-29T23:00:00+00:00 EmrJobFlowSensor 2021-06-30T23:01:06.852313+00:00 2021-06-30T23:11:09.810328+00:00 0:10:02.958015 48122 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T23:01:04.661674+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-30T22:00:00+00:00 EmrJobFlowSensor 2021-06-30T23:01:01.079018+00:00 2021-06-30T23:11:03.961101+00:00 0:10:02.882083 48121 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T23:00:58.674989+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-30T22:00:00+00:00 EmrJobFlowSensor 2021-06-30T23:00:58.853313+00:00 2021-06-30T23:12:02.015412+00:00 0:11:03.162099 48120 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T23:00:56.604204+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 create_cluster_and_add_emr_steps 2021-06-29T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T23:00:42.882853+00:00 2021-06-30T23:00:44.589624+00:00 0:00:01.706771 48119 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T23:00:40.593106+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-30T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T23:00:37.026957+00:00 2021-06-30T23:00:38.764138+00:00 0:00:01.737181 48118 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-30T23:00:34.644072+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-30T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T23:00:37.041983+00:00 2021-06-30T23:00:38.908142+00:00 0:00:01.866159 48117 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T23:00:34.644100+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 create_emr_steps 2021-06-29T23:00:00+00:00 PythonOperator 2021-06-30T23:00:18.747764+00:00 2021-06-30T23:00:22.218801+00:00 0:00:03.471037 48116 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T23:00:16.503385+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-30T22:00:00+00:00 PythonOperator 2021-06-30T23:00:15.339179+00:00 2021-06-30T23:00:18.986475+00:00 0:00:03.647296 48115 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-30T23:00:12.566267+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-30T22:00:00+00:00 PythonOperator 2021-06-30T23:00:13.018430+00:00 2021-06-30T23:00:17.408362+00:00 0:00:04.389932 48114 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T23:00:10.559372+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-30T21:00:00+00:00 TriggerDagRunOperator 2021-06-30T22:10:27.300339+00:00 2021-06-30T22:10:27.789241+00:00 0:00:00.488902 48113 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T22:10:24.903941+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-30T21:00:00+00:00 TriggerDagRunOperator 2021-06-30T22:10:27.075054+00:00 2021-06-30T22:10:27.464066+00:00 0:00:00.389012 48112 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T22:10:24.903906+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-30T21:05:00+00:00 EmrJobFlowSensor 2021-06-30T22:06:56.788400+00:00 2021-06-30T22:14:59.482001+00:00 0:08:02.693601 48111 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T22:06:54.575669+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-30T21:05:00+00:00 EmrCreateJobFlowOperator 2021-06-30T22:06:34.852761+00:00 2021-06-30T22:06:36.505991+00:00 0:00:01.653230 48110 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T22:06:32.493416+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-30T21:05:00+00:00 PythonOperator 2021-06-30T22:05:25.044435+00:00 2021-06-30T22:05:27.976388+00:00 0:00:02.931953 48108 airflow-worker-2.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T22:05:22.681736+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-30T21:00:00+00:00 EmrJobFlowSensor 2021-06-30T22:01:13.230062+00:00 2021-06-30T22:14:16.630074+00:00 0:13:03.400012 48107 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T22:01:10.313963+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-30T21:00:00+00:00 EmrJobFlowSensor 2021-06-30T22:01:10.947388+00:00 2021-06-30T22:10:14.190361+00:00 0:09:03.242973 48106 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T22:01:08.376664+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-30T21:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T22:00:52.988694+00:00 2021-06-30T22:00:54.811848+00:00 0:00:01.823154 48105 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T22:00:50.357522+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-30T21:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T22:00:46.569607+00:00 2021-06-30T22:00:48.390964+00:00 0:00:01.821357 48104 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-30T22:00:44.292138+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-30T21:00:00+00:00 PythonOperator 2021-06-30T22:00:30.974553+00:00 2021-06-30T22:00:35.155502+00:00 0:00:04.180949 48103 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T22:00:28.362089+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-30T21:00:00+00:00 PythonOperator 2021-06-30T22:00:20.585122+00:00 2021-06-30T22:00:24.182489+00:00 0:00:03.597367 48102 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-30T22:00:18.250409+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-30T20:00:00+00:00 TriggerDagRunOperator 2021-06-30T21:11:35.533349+00:00 2021-06-30T21:11:36.064439+00:00 0:00:00.531090 48101 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T21:11:33.052878+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-30T20:00:00+00:00 TriggerDagRunOperator 2021-06-30T21:11:35.483484+00:00 2021-06-30T21:11:35.890999+00:00 0:00:00.407515 48100 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T21:11:33.052833+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-30T20:05:00+00:00 EmrJobFlowSensor 2021-06-30T21:06:20.154588+00:00 2021-06-30T21:15:22.925276+00:00 0:09:02.770688 48099 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T21:06:18.087562+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-30T20:05:00+00:00 EmrCreateJobFlowOperator 2021-06-30T21:05:58.264667+00:00 2021-06-30T21:06:00.087862+00:00 0:00:01.823195 48098 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T21:05:56.036374+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-30T20:05:00+00:00 PythonOperator 2021-06-30T21:05:38.584508+00:00 2021-06-30T21:05:42.240297+00:00 0:00:03.655789 48097 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T21:05:36.021812+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-30T20:00:00+00:00 EmrJobFlowSensor 2021-06-30T21:01:26.720114+00:00 2021-06-30T21:11:29.771831+00:00 0:10:03.051717 48095 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T21:01:24.415874+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-30T20:00:00+00:00 EmrJobFlowSensor 2021-06-30T21:01:20.723858+00:00 2021-06-30T21:12:23.894307+00:00 0:11:03.170449 48094 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T21:01:18.406968+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-30T20:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T21:00:54.824567+00:00 2021-06-30T21:00:56.656837+00:00 0:00:01.832270 48093 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-30T21:00:52.390399+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-30T20:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T21:00:48.670198+00:00 2021-06-30T21:00:50.399125+00:00 0:00:01.728927 48092 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T21:00:46.379070+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-30T20:00:00+00:00 PythonOperator 2021-06-30T21:00:23.214547+00:00 2021-06-30T21:00:26.893198+00:00 0:00:03.678651 48091 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T21:00:20.357913+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-30T20:00:00+00:00 PythonOperator 2021-06-30T21:00:23.133083+00:00 2021-06-30T21:00:26.774433+00:00 0:00:03.641350 48090 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-30T21:00:20.357954+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-30T19:00:00+00:00 TriggerDagRunOperator 2021-06-30T20:11:13.118801+00:00 2021-06-30T20:11:13.617607+00:00 0:00:00.498806 48089 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T20:11:10.837342+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-30T19:00:00+00:00 TriggerDagRunOperator 2021-06-30T20:11:13.008901+00:00 2021-06-30T20:11:13.393961+00:00 0:00:00.385060 48088 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T20:11:10.837314+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-30T19:05:00+00:00 EmrJobFlowSensor 2021-06-30T20:06:12.491001+00:00 2021-06-30T20:14:15.085967+00:00 0:08:02.594966 48087 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T20:06:10.196167+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-30T19:05:00+00:00 EmrCreateJobFlowOperator 2021-06-30T20:05:50.259650+00:00 2021-06-30T20:05:51.905585+00:00 0:00:01.645935 48086 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T20:05:48.160685+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-30T19:05:00+00:00 PythonOperator 2021-06-30T20:05:26.392791+00:00 2021-06-30T20:05:29.973464+00:00 0:00:03.580673 48085 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T20:05:24.100125+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-30T19:00:00+00:00 EmrJobFlowSensor 2021-06-30T20:00:58.354886+00:00 2021-06-30T20:11:01.345585+00:00 0:10:02.990699 48083 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T20:00:55.968872+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-30T19:00:00+00:00 EmrJobFlowSensor 2021-06-30T20:00:56.090381+00:00 2021-06-30T20:12:59.258208+00:00 0:12:03.167827 48082 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T20:00:53.923036+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-30T19:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T20:00:36.830961+00:00 2021-06-30T20:00:38.578223+00:00 0:00:01.747262 48081 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-30T20:00:33.967742+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-30T19:00:00+00:00 EmrCreateJobFlowOperator 2021-06-30T20:00:36.525423+00:00 2021-06-30T20:00:38.370203+00:00 0:00:01.844780 48080 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T20:00:33.967774+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-30T19:00:00+00:00 PythonOperator 2021-06-30T20:00:14.203074+00:00 2021-06-30T20:00:17.894404+00:00 0:00:03.691330 48079 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-30T20:00:11.823118+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-30T19:00:00+00:00 PythonOperator 2021-06-30T20:00:14.182273+00:00 2021-06-30T20:00:17.937727+00:00 0:00:03.755454 48078 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T20:00:11.823146+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-30T18:00:00+00:00 TriggerDagRunOperator 2021-06-30T19:10:29.110836+00:00 2021-06-30T19:10:29.590329+00:00 0:00:00.479493 48077 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T19:10:26.380063+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-30T18:00:00+00:00 TriggerDagRunOperator 2021-06-30T19:10:28.809162+00:00 2021-06-30T19:10:29.291384+00:00 0:00:00.482222 48076 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T19:10:26.380108+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-30T18:05:00+00:00 EmrJobFlowSensor 2021-06-30T19:06:07.823662+00:00 2021-06-30T19:15:10.568169+00:00 0:09:02.744507 48075 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T19:06:05.654767+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-30T18:05:00+00:00 EmrCreateJobFlowOperator 2021-06-30T19:05:45.948883+00:00 2021-06-30T19:05:47.576518+00:00 0:00:01.627635 48074 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-30T19:05:43.604829+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-30T18:05:00+00:00 PythonOperator 2021-06-30T19:05:23.882346+00:00 2021-06-30T19:05:27.450485+00:00 0:00:03.568139 48073 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T19:05:21.558140+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-30T18:00:00+00:00 EmrJobFlowSensor 2021-06-30T19:01:41.912770+00:00 2021-06-30T19:13:45.077372+00:00 0:12:03.164602 48071 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-30T19:01:39.577755+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-30T18:00:00+00:00 EmrJobFlowSensor 2021-06-30T19:01:19.954163+00:00 2021-06-30T19:10:22.868586+00:00 0:09:02.914423 48070 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-30T19:01:17.507724+00:00 2 default_pool