Task Instances

  State Dag Id Task Id Execution Date Operator Start Date End Date Duration Job Id Hostname Unixname Priority Weight Queue Queued Dttm Try Number Pool Log Url
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-21T02:05:00+00:00 EmrCreateJobFlowOperator 2021-06-21T03:05:28.982927+00:00 2021-06-21T03:05:30.640410+00:00 0:00:01.657483 43869 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T03:05:26.322800+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-21T02:05:00+00:00 PythonOperator 2021-06-21T03:05:06.667274+00:00 2021-06-21T03:05:09.996094+00:00 0:00:03.328820 43868 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T03:05:04.295863+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-21T02:00:00+00:00 EmrJobFlowSensor 2021-06-21T03:00:52.046670+00:00 2021-06-21T03:11:54.872619+00:00 0:11:02.825949 43867 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T03:00:49.862793+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-21T02:00:00+00:00 EmrJobFlowSensor 2021-06-21T03:00:48.141266+00:00 2021-06-21T03:09:51.034947+00:00 0:09:02.893681 43866 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T03:00:45.855618+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-21T02:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T03:00:30.065541+00:00 2021-06-21T03:00:31.866770+00:00 0:00:01.801229 43865 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T03:00:27.852935+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-21T02:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T03:00:28.124304+00:00 2021-06-21T03:00:29.859769+00:00 0:00:01.735465 43864 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-21T03:00:25.839889+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-21T02:00:00+00:00 PythonOperator 2021-06-21T03:00:10.894281+00:00 2021-06-21T03:00:14.930447+00:00 0:00:04.036166 43863 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T03:00:07.824750+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-21T02:00:00+00:00 PythonOperator 2021-06-21T03:00:06.390680+00:00 2021-06-21T03:00:10.843735+00:00 0:00:04.453055 43862 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-21T03:00:03.818977+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-21T01:00:00+00:00 EmrJobFlowSensor 2021-06-21T02:12:39.840160+00:00 2021-06-21T02:21:42.621415+00:00 0:09:02.781255 43860 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T02:12:37.527726+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-21T01:00:00+00:00 EmrJobFlowSensor 2021-06-21T02:12:33.705528+00:00 2021-06-21T02:21:36.536377+00:00 0:09:02.830849 43859 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T02:12:31.439646+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-21T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T02:12:03.710019+00:00 2021-06-21T02:12:05.470210+00:00 0:00:01.760191 43858 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T02:12:01.415391+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-21T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T02:12:00.131335+00:00 2021-06-21T02:12:02.117351+00:00 0:00:01.986016 43857 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T02:11:57.414661+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-21T01:00:00+00:00 PythonOperator 2021-06-21T02:11:39.824403+00:00 2021-06-21T02:11:43.630319+00:00 0:00:03.805916 43856 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T02:11:37.398101+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-21T01:00:00+00:00 PythonOperator 2021-06-21T02:11:33.587567+00:00 2021-06-21T02:11:37.080557+00:00 0:00:03.492990 43855 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T02:11:31.385976+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-21T01:00:00+00:00 TriggerDagRunOperator 2021-06-21T02:11:17.615925+00:00 2021-06-21T02:11:18.120907+00:00 0:00:00.504982 43854 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T02:11:15.340385+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-21T01:00:00+00:00 TriggerDagRunOperator 2021-06-21T02:11:17.561023+00:00 2021-06-21T02:11:17.994703+00:00 0:00:00.433680 43853 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T02:11:15.340347+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-21T01:05:00+00:00 EmrJobFlowSensor 2021-06-21T02:05:53.159735+00:00 2021-06-21T02:14:55.790981+00:00 0:09:02.631246 43852 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T02:05:50.748424+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-21T01:05:00+00:00 EmrCreateJobFlowOperator 2021-06-21T02:05:31.112347+00:00 2021-06-21T02:05:32.841981+00:00 0:00:01.729634 43851 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T02:05:28.749372+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-21T01:05:00+00:00 PythonOperator 2021-06-21T02:05:08.874191+00:00 2021-06-21T02:05:12.326048+00:00 0:00:03.451857 43850 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T02:05:06.629186+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-21T01:00:00+00:00 EmrJobFlowSensor 2021-06-21T02:01:02.494814+00:00 2021-06-21T02:13:05.741863+00:00 0:12:03.247049 43849 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T02:01:00.303629+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-21T01:00:00+00:00 EmrJobFlowSensor 2021-06-21T02:00:54.614690+00:00 2021-06-21T02:10:57.565275+00:00 0:10:02.950585 43848 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T02:00:52.259453+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-21T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T02:00:40.354084+00:00 2021-06-21T02:00:42.055236+00:00 0:00:01.701152 43847 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T02:00:38.246240+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-21T01:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T02:00:32.564322+00:00 2021-06-21T02:00:34.409895+00:00 0:00:01.845573 43846 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-21T02:00:30.241183+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-21T01:00:00+00:00 PythonOperator 2021-06-21T02:00:18.531349+00:00 2021-06-21T02:00:22.237198+00:00 0:00:03.705849 43845 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T02:00:16.278827+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-21T01:00:00+00:00 PythonOperator 2021-06-21T02:00:10.726986+00:00 2021-06-21T02:00:14.080290+00:00 0:00:03.353304 43844 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-21T02:00:08.230626+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-21T00:00:00+00:00 EmrJobFlowSensor 2021-06-21T01:11:47.116436+00:00 2021-06-21T01:20:49.747446+00:00 0:09:02.631010 43842 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T01:11:44.966456+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-21T00:00:00+00:00 EmrJobFlowSensor 2021-06-21T01:11:29.345733+00:00 2021-06-21T01:20:32.178372+00:00 0:09:02.832639 43841 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T01:11:26.960646+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-21T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T01:11:15.184553+00:00 2021-06-21T01:11:16.900205+00:00 0:00:01.715652 43840 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T01:11:12.940147+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-21T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T01:10:57.444168+00:00 2021-06-21T01:10:59.097803+00:00 0:00:01.653635 43839 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T01:10:54.923007+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-21T00:00:00+00:00 PythonOperator 2021-06-21T01:10:49.212887+00:00 2021-06-21T01:10:52.738118+00:00 0:00:03.525231 43838 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T01:10:46.960378+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-21T00:00:00+00:00 PythonOperator 2021-06-21T01:10:37.146228+00:00 2021-06-21T01:10:40.719815+00:00 0:00:03.573587 43837 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T01:10:34.906927+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-21T00:00:00+00:00 TriggerDagRunOperator 2021-06-21T01:10:25.490575+00:00 2021-06-21T01:10:25.991414+00:00 0:00:00.500839 43836 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T01:10:22.944365+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-21T00:00:00+00:00 TriggerDagRunOperator 2021-06-21T01:10:25.381722+00:00 2021-06-21T01:10:25.768196+00:00 0:00:00.386474 43835 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T01:10:22.944410+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-21T00:05:00+00:00 EmrJobFlowSensor 2021-06-21T01:06:15.109878+00:00 2021-06-21T01:14:17.694673+00:00 0:08:02.584795 43834 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T01:06:12.656371+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-21T00:05:00+00:00 EmrCreateJobFlowOperator 2021-06-21T01:05:52.964882+00:00 2021-06-21T01:05:54.722310+00:00 0:00:01.757428 43833 airflow-worker-3.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T01:05:50.569908+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-21T00:05:00+00:00 PythonOperator 2021-06-21T01:05:30.878204+00:00 2021-06-21T01:05:34.395686+00:00 0:00:03.517482 43832 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T01:05:28.551237+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-21T00:00:00+00:00 EmrJobFlowSensor 2021-06-21T01:01:06.183838+00:00 2021-06-21T01:10:08.967388+00:00 0:09:02.783550 43831 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T01:01:04.029346+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-21T00:00:00+00:00 EmrJobFlowSensor 2021-06-21T01:00:54.345223+00:00 2021-06-21T01:12:57.529830+00:00 0:12:03.184607 43830 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T01:00:52.063228+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-21T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T01:00:44.218878+00:00 2021-06-21T01:00:45.989671+00:00 0:00:01.770793 43829 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-21T01:00:42.012199+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-21T00:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T01:00:32.494422+00:00 2021-06-21T01:00:34.189720+00:00 0:00:01.695298 43828 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T01:00:30.076266+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-21T00:00:00+00:00 PythonOperator 2021-06-21T01:00:24.352116+00:00 2021-06-21T01:00:27.674131+00:00 0:00:03.322015 43827 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-21T01:00:21.991723+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-21T00:00:00+00:00 PythonOperator 2021-06-21T01:00:10.415716+00:00 2021-06-21T01:00:14.016683+00:00 0:00:03.600967 43826 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T01:00:07.981142+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-20T23:00:00+00:00 EmrJobFlowSensor 2021-06-21T00:12:33.765029+00:00 2021-06-21T00:22:36.575179+00:00 0:10:02.810150 43824 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T00:12:31.458038+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-20T23:00:00+00:00 EmrJobFlowSensor 2021-06-21T00:12:27.883685+00:00 2021-06-21T00:21:30.777094+00:00 0:09:02.893409 43823 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T00:12:25.466854+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-20T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T00:12:11.621662+00:00 2021-06-21T00:12:13.354446+00:00 0:00:01.732784 43822 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T00:12:09.392500+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-20T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T00:12:07.471675+00:00 2021-06-21T00:12:09.170640+00:00 0:00:01.698965 43821 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T00:12:05.373501+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-20T23:00:00+00:00 PythonOperator 2021-06-21T00:11:51.564875+00:00 2021-06-21T00:11:55.120626+00:00 0:00:03.555751 43820 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T00:11:49.359914+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-20T23:00:00+00:00 PythonOperator 2021-06-21T00:11:45.681751+00:00 2021-06-21T00:11:49.405435+00:00 0:00:03.723684 43819 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T00:11:43.355311+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-20T23:00:00+00:00 TriggerDagRunOperator 2021-06-21T00:11:31.763307+00:00 2021-06-21T00:11:32.269561+00:00 0:00:00.506254 43818 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T00:11:29.376901+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-20T23:00:00+00:00 TriggerDagRunOperator 2021-06-21T00:11:31.621045+00:00 2021-06-21T00:11:32.012102+00:00 0:00:00.391057 43817 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T00:11:29.376862+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-20T23:05:00+00:00 EmrJobFlowSensor 2021-06-21T00:05:55.042890+00:00 2021-06-21T00:13:57.701815+00:00 0:08:02.658925 43816 airflow-worker-2.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T00:05:52.759631+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-20T23:05:00+00:00 EmrCreateJobFlowOperator 2021-06-21T00:05:24.878529+00:00 2021-06-21T00:05:26.547276+00:00 0:00:01.668747 43815 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T00:05:22.733953+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-20T23:05:00+00:00 PythonOperator 2021-06-21T00:05:04.864429+00:00 2021-06-21T00:05:08.382685+00:00 0:00:03.518256 43814 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T00:05:02.716732+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-20T23:00:00+00:00 EmrJobFlowSensor 2021-06-21T00:01:04.698428+00:00 2021-06-21T00:11:07.541086+00:00 0:10:02.842658 43813 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T00:01:02.419496+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-20T23:00:00+00:00 EmrJobFlowSensor 2021-06-21T00:00:46.783067+00:00 2021-06-21T00:12:49.836418+00:00 0:12:03.053351 43812 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-21T00:00:44.461387+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-20T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T00:00:42.560409+00:00 2021-06-21T00:00:44.302130+00:00 0:00:01.741721 43811 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-21T00:00:40.391444+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-20T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-21T00:00:26.716610+00:00 2021-06-21T00:00:28.544232+00:00 0:00:01.827622 43810 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-21T00:00:24.363092+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-20T23:00:00+00:00 PythonOperator 2021-06-21T00:00:22.531563+00:00 2021-06-21T00:00:26.008134+00:00 0:00:03.476571 43809 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-21T00:00:20.350869+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-20T23:00:00+00:00 PythonOperator 2021-06-21T00:00:04.862965+00:00 2021-06-21T00:00:08.799650+00:00 0:00:03.936685 43808 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-21T00:00:02.382573+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-20T22:00:00+00:00 EmrJobFlowSensor 2021-06-20T23:11:18.363252+00:00 2021-06-20T23:21:21.300635+00:00 0:10:02.937383 43806 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T23:11:15.995861+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-20T22:00:00+00:00 EmrJobFlowSensor 2021-06-20T23:11:08.292235+00:00 2021-06-20T23:21:11.233274+00:00 0:10:02.941039 43805 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T23:11:05.984989+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-20T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T23:10:56.662582+00:00 2021-06-20T23:10:58.496552+00:00 0:00:01.833970 43804 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T23:10:53.938645+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-20T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T23:10:48.223822+00:00 2021-06-20T23:10:50.048305+00:00 0:00:01.824483 43803 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T23:10:45.939343+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-20T22:00:00+00:00 PythonOperator 2021-06-20T23:10:34.237863+00:00 2021-06-20T23:10:37.548352+00:00 0:00:03.310489 43802 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T23:10:31.899502+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-20T22:00:00+00:00 PythonOperator 2021-06-20T23:10:26.172108+00:00 2021-06-20T23:10:30.078543+00:00 0:00:03.906435 43801 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T23:10:23.961684+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-20T22:00:00+00:00 TriggerDagRunOperator 2021-06-20T23:10:16.332949+00:00 2021-06-20T23:10:16.851492+00:00 0:00:00.518543 43800 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T23:10:13.948085+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-20T22:00:00+00:00 TriggerDagRunOperator 2021-06-20T23:10:16.172782+00:00 2021-06-20T23:10:16.569200+00:00 0:00:00.396418 43799 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T23:10:13.948123+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-20T22:05:00+00:00 EmrJobFlowSensor 2021-06-20T23:06:01.753934+00:00 2021-06-20T23:15:04.422296+00:00 0:09:02.668362 43798 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T23:05:59.479357+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-20T22:05:00+00:00 EmrCreateJobFlowOperator 2021-06-20T23:05:39.708246+00:00 2021-06-20T23:05:41.452596+00:00 0:00:01.744350 43797 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T23:05:37.425086+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-20T22:05:00+00:00 PythonOperator 2021-06-20T23:05:15.814976+00:00 2021-06-20T23:05:19.204926+00:00 0:00:03.389950 43796 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T23:05:13.457779+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 check_cluster_status 2021-06-19T23:00:00+00:00 EmrJobFlowSensor 2021-06-20T23:00:58.944921+00:00 2021-06-20T23:09:01.532196+00:00 0:08:02.587275 43795 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T23:00:56.848536+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-20T22:00:00+00:00 EmrJobFlowSensor 2021-06-20T23:00:53.205410+00:00 2021-06-20T23:09:55.912840+00:00 0:09:02.707430 43794 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T23:00:50.857229+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-20T22:00:00+00:00 EmrJobFlowSensor 2021-06-20T23:00:49.306308+00:00 2021-06-20T23:12:52.576883+00:00 0:12:03.270575 43793 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T23:00:46.862361+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 create_cluster_and_add_emr_steps 2021-06-19T23:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T23:00:37.349891+00:00 2021-06-20T23:00:39.020237+00:00 0:00:01.670346 43792 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T23:00:34.795625+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-20T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T23:00:33.154718+00:00 2021-06-20T23:00:34.852316+00:00 0:00:01.697598 43791 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-20T23:00:30.790097+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-20T22:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T23:00:29.168822+00:00 2021-06-20T23:00:30.845879+00:00 0:00:01.677057 43790 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T23:00:26.781262+00:00 2 default_pool
success campaign-delta-past-delete-job_v002 create_emr_steps 2021-06-19T23:00:00+00:00 PythonOperator 2021-06-20T23:00:16.877422+00:00 2021-06-20T23:00:20.243742+00:00 0:00:03.366320 43789 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T23:00:14.761114+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-20T22:00:00+00:00 PythonOperator 2021-06-20T23:00:10.903676+00:00 2021-06-20T23:00:14.493511+00:00 0:00:03.589835 43788 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-20T23:00:08.756565+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-20T22:00:00+00:00 PythonOperator 2021-06-20T23:00:07.066615+00:00 2021-06-20T23:00:10.534904+00:00 0:00:03.468289 43787 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T23:00:04.752919+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-20T21:00:00+00:00 EmrJobFlowSensor 2021-06-20T22:12:26.640449+00:00 2021-06-20T22:21:29.239611+00:00 0:09:02.599162 43785 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T22:12:24.407055+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-20T21:00:00+00:00 EmrJobFlowSensor 2021-06-20T22:12:02.974153+00:00 2021-06-20T22:22:05.851649+00:00 0:10:02.877496 43784 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T22:12:00.464296+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-20T21:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T22:11:56.866523+00:00 2021-06-20T22:11:58.710506+00:00 0:00:01.843983 43783 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T22:11:54.370103+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-20T21:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T22:11:41.575959+00:00 2021-06-20T22:11:43.298866+00:00 0:00:01.722907 43782 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T22:11:38.316732+00:00 2 default_pool
success campaign-history-job_v002 create_emr_steps 2021-06-20T21:00:00+00:00 PythonOperator 2021-06-20T22:11:36.486182+00:00 2021-06-20T22:11:41.053260+00:00 0:00:04.567078 43781 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T22:11:34.307023+00:00 2 default_pool
success booking-processing-job_v002 create_emr_steps 2021-06-20T21:00:00+00:00 PythonOperator 2021-06-20T22:11:18.997233+00:00 2021-06-20T22:11:22.800195+00:00 0:00:03.802962 43780 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T22:11:16.291346+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_booking-processing-job_v002 2021-06-20T21:00:00+00:00 TriggerDagRunOperator 2021-06-20T22:11:10.980269+00:00 2021-06-20T22:11:11.493056+00:00 0:00:00.512787 43779 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T22:11:08.358409+00:00 2 default_pool
success campaign-flow-job_v002 trigger_dagrun_campaign-history-job_v002 2021-06-20T21:00:00+00:00 TriggerDagRunOperator 2021-06-20T22:11:10.773656+00:00 2021-06-20T22:11:11.206841+00:00 0:00:00.433185 43778 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T22:11:08.358364+00:00 2 default_pool
success vc-asset-import_v002 check_cluster_status 2021-06-20T21:05:00+00:00 EmrJobFlowSensor 2021-06-20T22:05:56.069128+00:00 2021-06-20T22:14:58.895251+00:00 0:09:02.826123 43777 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T22:05:53.733395+00:00 2 default_pool
success vc-asset-import_v002 create_cluster_and_add_emr_steps 2021-06-20T21:05:00+00:00 EmrCreateJobFlowOperator 2021-06-20T22:05:33.860326+00:00 2021-06-20T22:05:35.513141+00:00 0:00:01.652815 43776 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T22:05:31.713553+00:00 2 default_pool
success vc-asset-import_v002 create_emr_steps 2021-06-20T21:05:00+00:00 PythonOperator 2021-06-20T22:05:12.255709+00:00 2021-06-20T22:05:15.784252+00:00 0:00:03.528543 43775 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T22:05:09.693344+00:00 2 default_pool
success campaign-flow-job_v002 check_cluster_status 2021-06-20T21:00:00+00:00 EmrJobFlowSensor 2021-06-20T22:00:53.605750+00:00 2021-06-20T22:10:56.361745+00:00 0:10:02.755995 43774 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T22:00:51.351865+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 check_cluster_status 2021-06-20T21:00:00+00:00 EmrJobFlowSensor 2021-06-20T22:00:47.448741+00:00 2021-06-20T22:12:50.274871+00:00 0:12:02.826130 43773 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T22:00:45.294701+00:00 2 default_pool
success campaign-flow-job_v002 create_cluster_and_add_emr_steps 2021-06-20T21:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T22:00:31.912146+00:00 2021-06-20T22:00:33.653217+00:00 0:00:01.741071 43772 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 4 default 2021-06-20T22:00:29.369490+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_cluster_and_add_emr_steps 2021-06-20T21:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T22:00:25.359246+00:00 2021-06-20T22:00:27.039899+00:00 0:00:01.680653 43771 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T22:00:23.259356+00:00 2 default_pool
success campaign-flow-job_v002 create_emr_steps 2021-06-20T21:00:00+00:00 PythonOperator 2021-06-20T22:00:09.728991+00:00 2021-06-20T22:00:13.085323+00:00 0:00:03.356332 43770 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 5 default 2021-06-20T22:00:07.304901+00:00 2 default_pool
success livepop-shuffle-aggregator-modeltransform_v002 create_emr_steps 2021-06-20T21:00:00+00:00 PythonOperator 2021-06-20T22:00:05.759581+00:00 2021-06-20T22:00:09.423627+00:00 0:00:03.664046 43769 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 3 default 2021-06-20T22:00:03.245708+00:00 2 default_pool
success booking-processing-job_v002 check_cluster_status 2021-06-20T20:00:00+00:00 EmrJobFlowSensor 2021-06-20T21:12:09.017048+00:00 2021-06-20T21:22:11.856940+00:00 0:10:02.839892 43767 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T21:12:06.363913+00:00 2 default_pool
success campaign-history-job_v002 check_cluster_status 2021-06-20T20:00:00+00:00 EmrJobFlowSensor 2021-06-20T21:12:06.640414+00:00 2021-06-20T21:22:10.025279+00:00 0:10:03.384865 43766 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 1 default 2021-06-20T21:12:04.360226+00:00 2 default_pool
success campaign-history-job_v002 create_cluster_and_add_emr_steps 2021-06-20T20:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T21:11:46.732751+00:00 2021-06-20T21:11:48.570359+00:00 0:00:01.837608 43765 airflow-worker-1.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T21:11:44.346798+00:00 2 default_pool
success booking-processing-job_v002 create_cluster_and_add_emr_steps 2021-06-20T20:00:00+00:00 EmrCreateJobFlowOperator 2021-06-20T21:11:46.600824+00:00 2021-06-20T21:11:48.301178+00:00 0:00:01.700354 43764 airflow-worker-0.airflow-worker.bigdata.svc.cluster.local airflow 2 default 2021-06-20T21:11:44.346771+00:00 2 default_pool