:py:mod:`astronomer.providers.google.cloud.hooks.dataproc` ========================================================== .. py:module:: astronomer.providers.google.cloud.hooks.dataproc Module Contents --------------- Classes ~~~~~~~ .. autoapisummary:: astronomer.providers.google.cloud.hooks.dataproc.DataprocHookAsync Attributes ~~~~~~~~~~ .. autoapisummary:: astronomer.providers.google.cloud.hooks.dataproc.JobType .. py:data:: JobType .. py:class:: DataprocHookAsync(gcp_conn_id = 'google_cloud_default', delegate_to = None, impersonation_chain = None) Bases: :py:obj:`airflow.providers.google.common.hooks.base_google.GoogleBaseHook` Async Hook for Google Cloud Dataproc APIs .. py:method:: get_cluster_client(region = None, location = None) Get async cluster controller client for GCP Dataproc. :param region: The Cloud Dataproc region in which to handle the request. :param location: (To be deprecated). The Cloud Dataproc region in which to handle the request. .. py:method:: get_job_client(region = None, location = None) Get async job controller for GCP Dataproc. :param region: The Cloud Dataproc region in which to handle the request. :param location: (To be deprecated). The Cloud Dataproc region in which to handle the request. .. py:method:: get_cluster(region, cluster_name, project_id, retry = gapic_v1.method.DEFAULT, metadata = ()) :async: Get a cluster details from GCP using `ClusterControllerAsyncClient` :param region: The Cloud Dataproc region in which to handle the request :param cluster_name: The name of the cluster :param project_id: The ID of the Google Cloud project the cluster belongs to :param retry: A retry object used to retry requests. If ``None`` is specified, requests will not be retried :param metadata: Additional metadata that is provided to the method .. py:method:: get_job(job_id, project_id, timeout = 5, region = None, location = None, retry = gapic_v1.method.DEFAULT, metadata = ()) :async: Gets the resource representation for a job using `JobControllerAsyncClient`. :param job_id: Id of the Dataproc job :param project_id: Required. The ID of the Google Cloud project the cluster belongs to. :param region: Required. The Cloud Dataproc region in which to handle the request. :param location: (To be deprecated). The Cloud Dataproc region in which to handle the request. :param retry: A retry object used to retry requests. If ``None`` is specified, requests will not be retried. :param timeout: The amount of time, in seconds, to wait for the request to complete. Note that if ``retry`` is specified, the timeout applies to each individual attempt. :param metadata: Additional metadata that is provided to the method.