Dependency | Reason |
---|---|
Task Instance State | Task is in the 'success' state which is not a valid state for execution. The task must be cleared in order to be run. |
Dagrun Running | Task instance's dagrun was not in the 'running' state but in the state 'success'. |
Dag Not Paused | Task's DAG 'campaign-flow-job_v002' is paused. |
Execution Date | The execution date is 2021-03-25T10:00:00+00:00 but this is before the task's start date 2024-09-19T21:00:00+00:00. |
Execution Date | The execution date is 2021-03-25T10:00:00+00:00 but this is before the task's DAG's start date 2024-09-19T21:00:00+00:00. |
Attribute | Value |
---|---|
dag_id | campaign-flow-job_v002 |
duration | 542.719152 |
end_date | 2021-03-25 11:10:09.630949+00:00 |
execution_date | 2021-03-25T10:00:00+00:00 |
executor_config | {} |
generate_command | <function TaskInstance.generate_command at 0x7f603554be18> |
hostname | airflow-worker-0.airflow-worker.bigdata.svc.cluster.local |
is_premature | False |
job_id | 11558 |
key | ('campaign-flow-job_v002', 'check_cluster_status', <Pendulum [2021-03-25T10:00:00+00:00]>, 2) |
log | <Logger airflow.task (INFO)> |
log_filepath | /opt/airflow/logs/campaign-flow-job_v002/check_cluster_status/2021-03-25T10:00:00+00:00.log |
log_url | https://airflow.devel.viooh.net.cn/admin/airflow/log?execution_date=2021-03-25T10%3A00%3A00%2B00%3A00&task_id=check_cluster_status&dag_id=campaign-flow-job_v002 |
logger | <Logger airflow.task (INFO)> |
mark_success_url | https://airflow.devel.viooh.net.cn/success?task_id=check_cluster_status&dag_id=campaign-flow-job_v002&execution_date=2021-03-25T10%3A00%3A00%2B00%3A00&upstream=false&downstream=false |
max_tries | 0 |
metadata | MetaData(bind=None) |
next_try_number | 2 |
operator | EmrJobFlowSensor |
pid | 22990 |
pool | default_pool |
pool_slots | 1 |
prev_attempted_tries | 1 |
previous_execution_date_success | 2021-03-25 09:00:00+00:00 |
previous_start_date_success | 2021-03-25 10:01:05.072783+00:00 |
previous_ti | <TaskInstance: campaign-flow-job_v002.check_cluster_status 2021-03-25 09:00:00+00:00 [success]> |
previous_ti_success | <TaskInstance: campaign-flow-job_v002.check_cluster_status 2021-03-25 09:00:00+00:00 [success]> |
priority_weight | 3 |
queue | default |
queued_dttm | 2021-03-25 11:01:04.787406+00:00 |
raw | False |
run_as_user | None |
start_date | 2021-03-25 11:01:06.911797+00:00 |
state | success |
task | <Task(EmrJobFlowSensor): check_cluster_status> |
task_id | check_cluster_status |
test_mode | False |
try_number | 2 |
unixname | airflow |
Attribute | Value |
---|---|
aws_conn_id | aws_default |
dag | <DAG: campaign-flow-job_v002> |
dag_id | campaign-flow-job_v002 |
depends_on_past | True |
deps | {<TIDep(Not Previously Skipped)>, <TIDep(Trigger Rule)>, <TIDep(Previous Dagrun State)>, <TIDep(Not In Retry Period)>} |
do_xcom_push | True |
downstream_list | [<Task(TriggerDagRunOperator): trigger_dagrun_booking-processing-job_v002>, <Task(TriggerDagRunOperator): trigger_dagrun_campaign-history-job_v002>] |
downstream_task_ids | {'trigger_dagrun_booking-processing-job_v002', 'trigger_dagrun_campaign-history-job_v002'} |
None | |
email_on_failure | True |
email_on_retry | True |
end_date | None |
execution_timeout | None |
executor_config | {} |
extra_links | [] |
failed_states | ['TERMINATED_WITH_ERRORS'] |
failure_message_from_response | <function EmrJobFlowSensor.failure_message_from_response at 0x7f602bcb49d8> |
global_operator_extra_link_dict | {} |
hook | None |
inlets | [] |
job_flow_id | {{ task_instance.xcom_pull(task_ids='create_cluster_and_add_emr_steps', key='return_value') }} |
lineage_data | None |
log | <Logger airflow.task.operators (INFO)> |
logger | <Logger airflow.task.operators (INFO)> |
max_retry_delay | None |
mode | poke |
on_failure_callback | <function task_fail_slack_alert at 0x7f602bc8d158> |
on_retry_callback | None |
on_success_callback | None |
operator_extra_link_dict | {} |
operator_extra_links | () |
outlets | [] |
owner | data.engineers@viooh.com |
params | {} |
poke_interval | 60 |
pool | default_pool |
pool_slots | 1 |
priority_weight | 1 |
priority_weight_total | 3 |
queue | default |
reschedule | False |
resources | None |
retries | 4 |
retry_delay | 0:01:00 |
retry_exponential_backoff | False |
run_as_user | None |
schedule_interval | 0 */1 * * * |
shallow_copy_attrs | () |
sla | None |
soft_fail | False |
start_date | 2024-09-19 21:00:00+00:00 |
state_from_response | <function EmrJobFlowSensor.state_from_response at 0x7f602bcb4950> |
subdag | None |
target_states | ['TERMINATED'] |
task_concurrency | None |
task_id | check_cluster_status |
task_type | EmrJobFlowSensor |
template_ext | () |
template_fields | ['job_flow_id', 'target_states', 'failed_states'] |
timeout | 604800 |
trigger_rule | all_success |
ui_color | #66c3ff |
ui_fgcolor | #000 |
upstream_list | [<Task(EmrCreateJobFlowOperator): create_cluster_and_add_emr_steps>] |
upstream_task_ids | {'create_cluster_and_add_emr_steps'} |
valid_modes | ['poke', 'reschedule'] |
wait_for_downstream | False |
weight_rule | downstream |