amazon.aws.triggers.s3

Module Contents

Classes

S3KeyTrigger

Base class for all triggers.

S3KeySizeTrigger

Base class for all triggers.

S3KeysUnchangedTrigger

Base class for all triggers.

S3PrefixTrigger

Base class for all triggers.

Attributes

log

amazon.aws.triggers.s3.log
class amazon.aws.triggers.s3.S3KeyTrigger(bucket_name, bucket_key, wildcard_match=False, aws_conn_id='aws_default', **hook_params)

Bases: airflow.triggers.base.BaseTrigger

Base class for all triggers.

A trigger has two contexts it can exist in:

  • Inside an Operator, when it’s passed to TaskDeferred

  • Actively running in a trigger worker

We use the same class for both situations, and rely on all Trigger classes to be able to return the (Airflow-JSON-encodable) arguments that will let them be re-instantiated elsewhere.

serialize(self)

Serialize S3KeyTrigger arguments and classpath.

async run(self)

Make an asynchronous connection using S3HookAsync.

class amazon.aws.triggers.s3.S3KeySizeTrigger(bucket_name, bucket_key, wildcard_match=False, aws_conn_id='aws_default', check_fn=None, **hook_params)

Bases: airflow.triggers.base.BaseTrigger

Base class for all triggers.

A trigger has two contexts it can exist in:

  • Inside an Operator, when it’s passed to TaskDeferred

  • Actively running in a trigger worker

We use the same class for both situations, and rely on all Trigger classes to be able to return the (Airflow-JSON-encodable) arguments that will let them be re-instantiated elsewhere.

serialize(self)

Serialize S3KeySizeTrigger arguments and classpath.

async run(self)

Make an asynchronous connection using S3HookAsync.

class amazon.aws.triggers.s3.S3KeysUnchangedTrigger(bucket_name, prefix, inactivity_period=60 * 60, min_objects=1, inactivity_seconds=0, previous_objects=set(), allow_delete=True, aws_conn_id='aws_default', last_activity_time=None, verify=None)

Bases: airflow.triggers.base.BaseTrigger

Base class for all triggers.

A trigger has two contexts it can exist in:

  • Inside an Operator, when it’s passed to TaskDeferred

  • Actively running in a trigger worker

We use the same class for both situations, and rely on all Trigger classes to be able to return the (Airflow-JSON-encodable) arguments that will let them be re-instantiated elsewhere.

serialize(self)

Serialize S3KeysUnchangedTrigger arguments and classpath.

async run(self)

Make an asynchronous connection using S3HookAsync.

class amazon.aws.triggers.s3.S3PrefixTrigger(*, bucket_name, prefix, delimiter='/', aws_conn_id='aws_default', verify=None, **hook_params)

Bases: airflow.triggers.base.BaseTrigger

Base class for all triggers.

A trigger has two contexts it can exist in:

  • Inside an Operator, when it’s passed to TaskDeferred

  • Actively running in a trigger worker

We use the same class for both situations, and rely on all Trigger classes to be able to return the (Airflow-JSON-encodable) arguments that will let them be re-instantiated elsewhere.

serialize(self)

Serialize S3PrefixTrigger arguments and classpath.

async run(self)

Make an asynchronous connection using S3HookAsync.