Skip to content

Add eventual consistency check for storage list_blobs() - #2181

Merged
dhermes merged 1 commit into
googleapis:masterfrom
dhermes:fix-2180
Aug 24, 2016
Merged

Add eventual consistency check for storage list_blobs()#2181
dhermes merged 1 commit into
googleapis:masterfrom
dhermes:fix-2180

Conversation

@dhermes

Copy link
Copy Markdown
Contributor

Fixes#2180.

@dhermesdhermes added api: storage Issues related to the Cloud Storage API. testing flaky labels Aug 24, 2016
@googlebotgooglebot added the cla: yes This human has signed the Contributor License Agreement. label Aug 24, 2016
@tseaver

Copy link
Copy Markdown
Contributor

LGTM

@dhermes
dhermes merged commit fccd91b into googleapis:masterAug 24, 2016
@dhermes
dhermes deleted the fix-2180 branch August 24, 2016 21:02
dhermes added a commit to dhermes/google-cloud-python that referenced this pull request Sep 9, 2016
This is not just "taking the easy way out", it's really
the most appropriate fix since there are so many
assertions that can fail due to eventual consistency. (For
example, asking for 2 blobs should have a next page when 3
are in the bucket, but this may break down due to eventual
consistency.)
Fixesgoogleapis#2217.
Also
- restoring test_second_level() to pre-googleapis#2252 (by retrying
the entire test case)
- restoring test_list_files() to pre-googleapis#2181 (by retrying
the entire test case)
- adding retries around remaining test cases that call
list_blobs(): test_root_level_w_delimiter(),
test_first_level() and test_third_level()
- adding a helper to empty a bucket in setUpClass() helper
(which also uses list_blobs()) in both TestStoragePseudoHierarchy
and TestStorageListFiles
dhermes added a commit to dhermes/google-cloud-python that referenced this pull request Sep 9, 2016
This is not just "taking the easy way out", it's really
the most appropriate fix since there are so many
assertions that can fail due to eventual consistency. (For
example, asking for 2 blobs should have a next page when 3
are in the bucket, but this may break down due to eventual
consistency.)
Fixesgoogleapis#2217.
Also
- restoring test_second_level() to pre-googleapis#2252 (by retrying
the entire test case)
- restoring test_list_files() to pre-googleapis#2181 (by retrying
the entire test case)
- adding retries around remaining test cases that call
list_blobs(): test_root_level_w_delimiter(),
test_first_level() and test_third_level()
- adding a helper to empty a bucket in setUpClass() helper
(which also uses list_blobs()) in both TestStoragePseudoHierarchy
and TestStorageListFiles
@dhermesdhermes mentioned this pull request Sep 19, 2016
parthea pushed a commit that referenced this pull request Mar 6, 2026
…ed (#2181)
* fix: fix total rows returned when both start_index and page_size are provided
* use shallow copy and add comments
* add docstring
* add unit test
* lint
* add comment
---------
Co-authored-by: Chalmer Lowe <chalmerlowe@google.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: storageIssues related to the Cloud Storage API.cla: yesThis human has signed the Contributor License Agreement.testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@dhermes@tseaver@daspecster@googlebot