databricks.operators.databricks

Module Contents

Classes

DatabricksSubmitRunOperatorAsync

DatabricksRunNowOperatorAsync

class databricks.operators.databricks.DatabricksSubmitRunOperatorAsync

Bases: airflow.providers.databricks.operators.databricks.DatabricksSubmitRunOperator

execute(self, context)

Execute the Databricks trigger, and defer execution as expected. It makes two non-async API calls to submit the run, and retrieve the run page URL. It also pushes these values as xcom data if do_xcom_push is set to True in the context.

execute_complete(self, context, event=None)

Callback for when the trigger fires - returns immediately. Relies on trigger to throw an exception, otherwise it assumes execution was successful.

class databricks.operators.databricks.DatabricksRunNowOperatorAsync

Bases: airflow.providers.databricks.operators.databricks.DatabricksRunNowOperator

execute(self, context)

Logic that the operator uses to execute the Databricks trigger, and defer execution as expected. It makes two non-async API calls to submit the run, and retrieve the run page URL. It also pushes these values as xcom data if do_xcom_push is set to True in the context.

execute_complete(self, context, event=None)

Callback for when the trigger fires - returns immediately. Relies on trigger to throw an exception, otherwise it assumes execution was successful.