:py:mod:`astronomer.providers.google.cloud.triggers.dataproc` ============================================================= .. py:module:: astronomer.providers.google.cloud.triggers.dataproc Module Contents --------------- Classes ~~~~~~~ .. autoapisummary:: astronomer.providers.google.cloud.triggers.dataproc.DataProcSubmitTrigger .. py:class:: DataProcSubmitTrigger(*, dataproc_job_id, region = None, project_id = None, gcp_conn_id = 'google_cloud_default', polling_interval = 5.0, **kwargs) Bases: :py:obj:`airflow.triggers.base.BaseTrigger` Check for the state of a previously submitted Dataproc job. :param dataproc_job_id: The Dataproc job ID to poll. (templated) :param region: Required. The Cloud Dataproc region in which to handle the request. (templated) :param project_id: The ID of the google cloud project in which to create the cluster. (templated) :param location: (To be deprecated). The Cloud Dataproc region in which to handle the request. (templated) :param gcp_conn_id: The connection ID to use connecting to Google Cloud Platform. :param wait_timeout: How many seconds wait for job to be ready. .. py:method:: serialize(self) Serializes DataProcSubmitTrigger arguments and classpath. .. py:method:: run(self) :async: Simple loop until the job running on Google Cloud DataProc is completed or not