astronomer.providers.apache.hive.triggers.named_hive_partition

Classes

NamedHivePartitionTrigger

A trigger that fires, and it looks for a partition in the given table

Module Contents

class astronomer.providers.apache.hive.triggers.named_hive_partition.NamedHivePartitionTrigger(partition_names, metastore_conn_id, polling_interval)[source]

Bases: airflow.triggers.base.BaseTrigger

A trigger that fires, and it looks for a partition in the given table in the database or wait for the partition.

Parameters:

  • partition_names (List[str]) – List of fully qualified names of the partitions to wait for.

  • metastore_conn_id (str) – connection string to connect to hive.

  • polling_interval (float) – polling period in seconds to check for the partition.

partition_names
polling_interval
metastore_conn_id: str
serialize()[source]

Serializes NamedHivePartitionTrigger arguments and classpath.

async run()[source]

Run until found all given partition in Hive.