astronomer.providers.amazon.aws.triggers.redshift_cluster

Classes

RedshiftClusterTrigger	RedshiftClusterTrigger is fired as deferred class with params to run the task in trigger worker
RedshiftClusterSensorTrigger	RedshiftClusterSensorTrigger is fired as deferred class with params to run the task in trigger worker

Module Contents

class astronomer.providers.amazon.aws.triggers.redshift_cluster.RedshiftClusterTrigger(task_id, aws_conn_id, cluster_identifier, operation_type, polling_period_seconds=5.0, skip_final_cluster_snapshot=True, final_cluster_snapshot_identifier=None)

Bases: airflow.triggers.base.BaseTrigger

RedshiftClusterTrigger is fired as deferred class with params to run the task in trigger worker

Parameters:

• task_id (str) – Reference to task id of the Dag

• polling_period_seconds (float) – polling period in seconds to check for the status

• aws_conn_id (str) – Reference to AWS connection id for redshift

• cluster_identifier (str) – unique identifier of a cluster

• operation_type (str) – Reference to the type of operation need to be performed eg: pause_cluster, resume_cluster, delete_cluster

• skip_final_cluster_snapshot (bool) – determines cluster snapshot creation

• final_cluster_snapshot_identifier (str | None) – name of final cluster snapshot

task_id

polling_period_seconds

aws_conn_id

cluster_identifier

operation_type

skip_final_cluster_snapshot

final_cluster_snapshot_identifier

serialize()

Serializes RedshiftClusterTrigger arguments and classpath.

async run()

Make async connection to redshift, based on the operation type call the RedshiftHookAsync functions if operation_type is ‘resume_cluster’ it will call the resume_cluster function in RedshiftHookAsync if operation_type is ‘pause_cluster it will call the pause_cluster function in RedshiftHookAsync

class astronomer.providers.amazon.aws.triggers.redshift_cluster.RedshiftClusterSensorTrigger(task_id, aws_conn_id, cluster_identifier, target_status, poke_interval)

Bases: airflow.triggers.base.BaseTrigger

RedshiftClusterSensorTrigger is fired as deferred class with params to run the task in trigger worker

This class is deprecated and will be removed in 2.0.0. Use :class: ~airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftClusterTrigger instead

Parameters:

• task_id (str) – Reference to task id of the Dag

• aws_conn_id (str) – Reference to AWS connection id for redshift

• cluster_identifier (str) – unique identifier of a cluster

• target_status (str) – Reference to the status which needs to be checked

• poke_interval (float) – polling period in seconds to check for the status

task_id

aws_conn_id

cluster_identifier

target_status

poke_interval

serialize()

Serializes RedshiftClusterSensorTrigger arguments and classpath.

async run()

Simple async function run until the cluster status match the target status.