Skip to content
This repository was archived by the owner on Mar 6, 2026. It is now read-only.

perf: cache first page of jobs.getQueryResults rows - #374

Merged
steffnay merged 2 commits into
googleapis:masterfrom
tswast:issue362-getQueryResults-cache
Nov 10, 2020
Merged

perf: cache first page of jobs.getQueryResults rows#374
steffnay merged 2 commits into
googleapis:masterfrom
tswast:issue362-getQueryResults-cache

Conversation

@tswast

@tswasttswast commented Nov 5, 2020

Copy link
Copy Markdown
Contributor

Replaces and simplifies #347 . The cache is only used if max_results, page_size, and start_index are not set.

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Towards #362 🦕

@tswast
tswast requested review from a team and steffnayNovember 5, 2020 22:44
@google-clagoogle-claBot added the cla: yes This human has signed the Contributor License Agreement. label Nov 5, 2020
@product-auto-labelproduct-auto-labelBot added the api: bigquery Issues related to the googleapis/python-bigquery API. label Nov 5, 2020
@tswast

Copy link
Copy Markdown
ContributorAuthor

@busunkim96 Could you or another Yoshi take a look at this PR? It makes some modifications to an overridden google.api_core.page_iterator and google.api_core.future.polling, so we'd like a sanity check from someone more familiar with those core libraries.

@tswasttswast mentioned this pull request Nov 6, 2020
7 tasks

@steffnaysteffnay left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@steffnay
steffnay merged commit 86f6a51 into googleapis:masterNov 10, 2020
tswast added a commit to tswast/python-bigquery that referenced this pull request Nov 24, 2020
When there are large result sets, fetching rows while waiting for the
query to finish can cause the API to hang indefinitely. (This may be due
to an interaction between connection timeout and API timeout.)
This reverts commit 86f6a51 (googleapis#374).
gcf-merge-on-greenBot pushed a commit that referenced this pull request Nov 24, 2020
When there are large result sets, fetching rows while waiting for the
query to finish can cause the API to hang indefinitely. (This may be due
to an interaction between connection timeout and API timeout.)
This reverts commit 86f6a51 (#374).
Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:
- [x] Make sure to open an issue as a [bug/issue](https://github.com/googleapis/python-bigquery/issues/new/choose) before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
- [x] Ensure the tests and linter pass
- [x] Code coverage does not decrease (if any source code was changed)
- [x] Appropriate docs were updated (if necessary)
Fixesgoogleapis/python-bigquery-pandas#343Fixes#394 🦕
@tswast
tswast deleted the issue362-getQueryResults-cache branch November 16, 2023 20:56
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

api: bigqueryIssues related to the googleapis/python-bigquery API.cla: yesThis human has signed the Contributor License Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@tswast@busunkim96@steffnay