astronomer.providers.apache.hive.sensors.named_hive_partition

Module Contents

Classes

NamedHivePartitionSensorAsync

Waits asynchronously for a set of partitions to show up in Hive.
class astronomer.providers.apache.hive.sensors.named_hive_partition.NamedHivePartitionSensorAsync(*, partition_names, metastore_conn_id='metastore_default', poke_interval=60 * 3, hook=None, **kwargs)[source]

Bases: airflow.providers.apache.hive.sensors.named_hive_partition.NamedHivePartitionSensor

Waits asynchronously for a set of partitions to show up in Hive.

Parameters

  • partition_names (List[str]) – List of fully qualified names of the partitions to wait for. A fully qualified name is of the form schema.table/pk1=pv1/pk2=pv2, for example, default.users/ds=2016-01-01.

  • metastore_conn_id (str) – Metastore thrift service connection id.

execute(self, context)[source]

Submit a job to Hive and defer

execute_complete(self, context, event=None)[source]

Callback for when the trigger fires - returns immediately. Relies on trigger to throw an exception, otherwise it assumes execution was successful.