Batch Operator Async¶
To execute a job asynchronously on AWS Batch
BatchOperatorAsync
.
submit_batch_job = BatchOperatorAsync(
task_id="submit_batch_job",
job_name=JOB_NAME,
job_queue=JOB_QUEUE,
job_definition=JOB_DEFINITION,
overrides=JOB_OVERRIDES,
aws_conn_id=AWS_CONN_ID,
region_name=AWS_DEFAULT_REGION,
)
# https://github.com/astronomer/astronomer-providers/tree/main/astronomer/providers/amazon/aws/example_dags/example_batch.py