Skip to content

add use_regex argument for allowing S3KeySensor to check s3 keys with regular expression - #36578

Merged
vincbeck merged 5 commits into
apache:mainfrom
astronomer:add-use-regex-to-S3KeySensor
Jan 10, 2024
Merged

add use_regex argument for allowing S3KeySensor to check s3 keys with regular expression#36578
vincbeck merged 5 commits into
apache:mainfrom
astronomer:add-use-regex-to-S3KeySensor

Conversation

@Lee-W

@Lee-WLee-W commented Jan 4, 2024

Copy link
Copy Markdown
Member

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborgboring-cyborgBot added area:providers provider:amazon AWS/Amazon - related issues labels Jan 4, 2024
@Lee-W
Lee-Wforce-pushed the add-use-regex-to-S3KeySensor branch 2 times, most recently from 796494b to ef390d8CompareJanuary 4, 2024 09:52

@dirraodirrao left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be great if we can add the test cases for the regex.

@Lee-W

Lee-W commented Jan 4, 2024

Copy link
Copy Markdown
MemberAuthor

It would be great if we can add the test cases for the regex.

Yep, will do. Thanks for suggestion 😄

@Lee-W
Lee-Wforce-pushed the add-use-regex-to-S3KeySensor branch from 2bce5f0 to 76eb51aCompareJanuary 8, 2024 09:25
@Lee-W
Lee-W marked this pull request as ready for review January 8, 2024 09:27
@Lee-WLee-W changed the title add use_regex to S3KeySensoradd use_regex for allowing S3KeySensor to check with regular expressionJan 8, 2024
@Lee-WLee-W changed the title add use_regex for allowing S3KeySensor to check with regular expressionadd use_regex argument for allowing S3KeySensor to check with regular expressionJan 8, 2024
@Lee-WLee-W changed the title add use_regex argument for allowing S3KeySensor to check with regular expressionadd use_regex argument for allowing S3KeySensor to check s3 keys with regular expressionJan 8, 2024
@Lee-W
Lee-Wforce-pushed the add-use-regex-to-S3KeySensor branch 2 times, most recently from b465528 to c005bffCompareJanuary 8, 2024 10:06

@vincbeckvincbeck left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like a cool feature users might be interested in. I think it is worth mentioning it in docs?

Comment threadairflow/providers/amazon/aws/sensors/s3.py Outdated
Comment threadairflow/providers/amazon/aws/triggers/s3.py Outdated
@Lee-W
Lee-Wforce-pushed the add-use-regex-to-S3KeySensor branch from c005bff to a459a42CompareJanuary 9, 2024 04:01
Comment threadtests/system/providers/amazon/aws/example_s3.py
@vincbeck
vincbeck merged commit 9f04716 into apache:mainJan 10, 2024
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providersprovider:amazonAWS/Amazon - related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@Lee-W@pankajkoti@dirrao@o-nikolas@phanikumv@vincbeck