:py:mod:`astronomer.providers.amazon.aws.triggers.emr` ====================================================== .. py:module:: astronomer.providers.amazon.aws.triggers.emr Module Contents --------------- Classes ~~~~~~~ .. autoapisummary:: astronomer.providers.amazon.aws.triggers.emr.EmrContainerBaseTrigger astronomer.providers.amazon.aws.triggers.emr.EmrJobFlowSensorTrigger .. py:class:: EmrContainerBaseTrigger(virtual_cluster_id, job_id, aws_conn_id = 'aws_default', poll_interval = 10, max_tries = None, **kwargs) Bases: :py:obj:`airflow.triggers.base.BaseTrigger` Poll for the status of EMR container until reaches terminal state :param virtual_cluster_id: Reference Emr cluster id :param job_id: job_id to check the state :param max_tries: maximum try attempts for polling the status :param aws_conn_id: Reference to AWS connection id :param poll_interval: polling period in seconds to check for the status .. py:class:: EmrJobFlowSensorTrigger(job_flow_id, aws_conn_id, poll_interval, target_states = None, failed_states = None) Bases: :py:obj:`airflow.triggers.base.BaseTrigger` EmrJobFlowSensorTrigger is fired as deferred class with params to run the task in trigger worker, when EMR JobFlow is created :param job_flow_id: job_flow_id to check the state of :param target_states: the target states, sensor waits until job flow reaches any of these states :param failed_states: the failure states, sensor fails when job flow reaches any of these states :param poll_interval: polling period in seconds to check for the status .. py:method:: serialize() Serializes EmrJobFlowSensorTrigger arguments and classpath. .. py:method:: run() :async: Make async connection to EMR container, polls for the target job state