Skip to content

chore: add a tool to upload tpcds data to bigquery. - #1367

Merged
Genesis929 merged 5 commits into
mainfrom
tpcds_uploader_huanc
Feb 6, 2025
Merged

chore: add a tool to upload tpcds data to bigquery.#1367
Genesis929 merged 5 commits into
mainfrom
tpcds_uploader_huanc

Conversation

@Genesis929

Copy link
Copy Markdown
Contributor

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@product-auto-labelproduct-auto-labelBot added size: l Pull request size is large. api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. labels Feb 6, 2025
@Genesis929
Genesis929 marked this pull request as ready for review February 6, 2025 00:03
@Genesis929
Genesis929 requested review from a teamFebruary 6, 2025 00:03
client.get_dataset(dataset_ref)
print(f"Dataset {project_id}:{dataset_id} already exists. Skipping.")
sys.exit(1)
except Exception:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: catch only dataset not exist exception

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated

@Genesis929
Genesis929 enabled auto-merge (squash) February 6, 2025 00:15
@Genesis929
Genesis929 merged commit aec3fe7 into mainFeb 6, 2025
@Genesis929
Genesis929 deleted the tpcds_uploader_huanc branch February 6, 2025 01:45
arwas11 pushed a commit that referenced this pull request Feb 6, 2025
* chore: add a tool to upload tpcds data to bigquery.
* update error type
* update docstring
tswast pushed a commit that referenced this pull request Feb 6, 2025
* feat: add GeoSeries.from_xy
* add from_xy test and update ibis types
* update geoseries notebook with from_xy
* Update docstring example
* fix doctstring lint error
* return GeometryDtype() for all ibis geo types
* chore: support timestamp subtractions (#1346)
* chore: support timestamp subtractions
* Fix format
* use tree rewrites to dispatch timestamp_diff operator
* add TODO for more node updates
* polish the code and fix typos
* fix comment
* add rewrites to compile_raw and compile_peek_sql
* chore: add a tool to upload tpcds data to bigquery. (#1367)
* chore: add a tool to upload tpcds data to bigquery.
* update error type
* update docstring
---------
Co-authored-by: Shenyang Cai <sycai@users.noreply.github.com>
Co-authored-by: Huan Chen <142538604+Genesis929@users.noreply.github.com>
shuoweil pushed a commit that referenced this pull request Feb 6, 2025
* feat: add GeoSeries.from_xy
* add from_xy test and update ibis types
* update geoseries notebook with from_xy
* Update docstring example
* fix doctstring lint error
* return GeometryDtype() for all ibis geo types
* chore: support timestamp subtractions (#1346)
* chore: support timestamp subtractions
* Fix format
* use tree rewrites to dispatch timestamp_diff operator
* add TODO for more node updates
* polish the code and fix typos
* fix comment
* add rewrites to compile_raw and compile_peek_sql
* chore: add a tool to upload tpcds data to bigquery. (#1367)
* chore: add a tool to upload tpcds data to bigquery.
* update error type
* update docstring
---------
Co-authored-by: Shenyang Cai <sycai@users.noreply.github.com>
Co-authored-by: Huan Chen <142538604+Genesis929@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: bigqueryIssues related to the googleapis/python-bigquery-dataframes API.size: lPull request size is large.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Genesis929@GarrettWu@TrevorBergeron