Skip to content
This repository was archived by the owner on Mar 6, 2026. It is now read-only.

perf: avoid extra API calls from to_dataframe if all rows are cached - #384

Merged
tswast merged 1 commit into
googleapis:masterfrom
tswast:issue362-to_dataframe
Nov 11, 2020
Merged

perf: avoid extra API calls from to_dataframe if all rows are cached#384
tswast merged 1 commit into
googleapis:masterfrom
tswast:issue362-to_dataframe

Conversation

@tswast

@tswasttswast commented Nov 11, 2020

Copy link
Copy Markdown
Contributor

Follow-up to previous PR, which cached the first page of
getQueryResults. If the first page is the only page (no pageToken),
then it is unnecessary to make extra API calls from to_dataframe or
to_arrow to the BigQuery Storage API.

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Towards #362 🦕

Follow-up to previous PR, which cached the first page of
`getQueryResults`. If the first page is the only page (no `pageToken`),
then it is unnecessary to make extra API calls from `to_dataframe` or
`to_arrow` to the BigQuery Storage API.
@tswast
tswast requested review from a team and stephaniewang526November 11, 2020 18:09
@product-auto-labelproduct-auto-labelBot added the api: bigquery Issues related to the googleapis/python-bigquery API. label Nov 11, 2020
@google-clagoogle-claBot added the cla: yes This human has signed the Contributor License Agreement. label Nov 11, 2020
@tswasttswast mentioned this pull request Nov 11, 2020
7 tasks
@tswast
tswast requested review from shollyman and removed request for stephaniewang526November 11, 2020 18:10

@shollymanshollyman left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The rows are coming...from inside the house!

@tswast
tswast merged commit c52b317 into googleapis:masterNov 11, 2020
@tswast
tswast deleted the issue362-to_dataframe branch November 11, 2020 21:03
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

api: bigqueryIssues related to the googleapis/python-bigquery API.cla: yesThis human has signed the Contributor License Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@tswast@shollyman