Named Hive Partition Sensor Async¶
To asynchronously submit a Spark application to the underlying cluster asynchronously
LivyOperatorAsync
.
livy_python_task = LivyOperatorAsync(
task_id="livy_python_task", file=LIVY_PYTHON_FILE, polling_interval=30
)
# https://github.com/astronomer/astronomer-providers/tree/main/astronomer/providers/apache/livy/example_dags/example_livy.py