astronomer.providers.amazon.aws.triggers.s3

Classes

S3KeyTrigger

S3KeyTrigger is fired as deferred class with params to run the task in trigger worker

Module Contents

class astronomer.providers.amazon.aws.triggers.s3.S3KeyTrigger(bucket_name, bucket_key, wildcard_match=False, use_regex=False, aws_conn_id='aws_default', poke_interval=5.0, soft_fail=False, should_check_fn=False, **hook_params)[source]

Bases: airflow.triggers.base.BaseTrigger

S3KeyTrigger is fired as deferred class with params to run the task in trigger worker

This class is deprecated and will be removed in 2.0.0. Use :class: ~airflow.providers.amazon.aws.triggers.s3.S3KeyTrigger instead

Parameters:

  • bucket_name (str) – Name of the S3 bucket. Only needed when bucket_key is not provided as a full s3:// url.

  • bucket_key (list[str]) – The key being waited on. Supports full s3:// style url or relative path from root level. When it’s specified as a full s3:// url, please leave bucket_name as None.

  • wildcard_match (bool) – whether the bucket_key should be interpreted as a Unix wildcard pattern

  • use_regex (bool) – whether to use regex to check bucket

  • aws_conn_id (str) – reference to the s3 connection

  • hook_params (Any) – params for hook its optional

  • soft_fail (bool) – Set to true to mark the task as SKIPPED on failure

bucket_name
bucket_key
wildcard_match
use_regex
aws_conn_id
hook_params
poke_interval
soft_fail
should_check_fn
serialize()[source]

Serialize S3KeyTrigger arguments and classpath.

async run()[source]

Make an asynchronous connection using S3HookAsync.