Skip to content

Retry whole batch of deletes on 429. - #4032

Closed
tseaver wants to merge 1 commit into
masterfrom
3761-storage-flaky-systest-cleanup
Closed

Retry whole batch of deletes on 429.#4032
tseaver wants to merge 1 commit into
masterfrom
3761-storage-flaky-systest-cleanup

Conversation

@tseaver

Copy link
Copy Markdown
Contributor

Because Bucket.delete inside a batch context manager is deferred, we cannot retry it directly. We also need to check for bucket existence, as the bucket may have been deleted successfully in the previous batch before the 429 was raised.

Closes#3761.

@tseavertseaver added api: storage Issues related to the Cloud Storage API. flaky labels Sep 22, 2017
@googlebotgooglebot added the cla: yes This human has signed the Contributor License Agreement. label Sep 22, 2017
@tseaver

Copy link
Copy Markdown
ContributorAuthor

CircleCI failures are unrelated vision flakiness (#4035).

Because 'Bucket.delete' inside a batch context manager is deferred,
we cannot retry it directly. We also need to check for bucket existence,
as the bucket *may* have been deleted in the previous batch before the
429 was raised.
Closes#3761.
@tseaver
tseaverforce-pushed the 3761-storage-flaky-systest-cleanup branch from aadbe77 to bccc5bcCompareSeptember 25, 2017 15:28
@tseaver

Copy link
Copy Markdown
ContributorAuthor

Rebased after merge of #4050. Fingers crossed.

@dhermes

Copy link
Copy Markdown
Contributor

@tseaver ISTM we should just drop the batch.

@tseaver

Copy link
Copy Markdown
ContributorAuthor

Superseded by #4102.

@tseavertseaver closed this Oct 2, 2017
@tseaver
tseaver deleted the 3761-storage-flaky-systest-cleanup branch October 2, 2017 20:11
tseaver added a commit that referenced this pull request Oct 2, 2017
Allows 429 errors to be handled by retry.
See:
#4032 (comment)
crwilcox pushed a commit to googleapis/python-storage that referenced this pull request Jan 31, 2020
cojenco pushed a commit to cojenco/python-storage that referenced this pull request Oct 13, 2021
cojenco pushed a commit to cojenco/python-storage that referenced this pull request Oct 13, 2021
parthea pushed a commit that referenced this pull request Mar 9, 2026
Allows 429 errors to be handled by retry.
See:
#4032 (comment)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: storageIssues related to the Cloud Storage API.cla: yesThis human has signed the Contributor License Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@tseaver@dhermes@lukesneeringer@googlebot