[BEAM-10399] Periodic clear of GCS wheels staging bucket

[TobKed]

Once per month clear GCS folders which do not have corresponding branches.

About cleaning up these GCS locations I consider two options:

• setting lifecycle management on the bucket which will delete files older than some arbitrary age, e.g. 365 days. I think advantage of this is that will be maintenance free.
• creating another scheduled workflow on github actions which will delete gcs folders if corresponding branch does not exist anymore. Could be scheduled to run e.g. once pre week.

#11877 (comment)
#11877 (comment)

Before merging

Before merging it is required to setup related secrets:

• GCP_PROJECT_ID

---

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

• Choose reviewer(s) and mention them in a comment (R: @username).
• Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
• Update CHANGES.md with noteworthy changes.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang	SDK	Apex	Dataflow	Flink	Gearpump	Samza	Spark
Go		---	---		---	---
Java
Python		---			---	---
XLang	---	---	---		---	---

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website
Non-portable
Portable	---		---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

[potiuk]

I think it's much better to put it all in separate bash script and call it from there. It's easier to analyse it this way

[mik-laj]

I agree. The bash script contained in the YAML file cannot be validated by shellcheck.

[TobKed]

Thanks for the suggestion. I moved it to the separate file. Looks much more nicer and it is easier do test script locally.

[TobKed]

R: @kamilwu@aaltay

[aaltay]

What files will be cleared this way? Release branches live forever. Would there be other branches that this script will clean?

[TobKed]

At the moment only master and release branches upload wheels to GCS. and after learning that release branches are kept forever this PR seems has no sense.