Skip to content

Add BigQuery SpatialBench benchmark run - #121

Draft
paleolimbot wants to merge 3 commits into
apache:mainfrom
paleolimbot:bigquery-runs
Draft

Add BigQuery SpatialBench benchmark run#121
paleolimbot wants to merge 3 commits into
apache:mainfrom
paleolimbot:bigquery-runs

Conversation

@paleolimbot

Copy link
Copy Markdown
Member

This is a work in progress, but thought this would be a productive place to put this while I work out the details.

The gist of this is that BigQuery has a mature and fully featured Geography implementation that is a good comparison for newer ones (like SedonaDB and Sedona Spark).

@paleolimbot

Copy link
Copy Markdown
MemberAuthor

@jiayuasu kindly reminded me that we don't put the cloud vendor versions here because they need credentials/money to run (and so there's no way for CI to validate that the code added here will actually run!).

For completeness, I'll put the scale factor 1 results here...as one might imagine, the per-query overhead is high but it does at least complete most of the queries.

============================================================
Running Bigquery Benchmark
============================================================
Bigquery version: 3.42.1
Pre-loading tables to BigQuery (scale factor: 1)...
Table loading complete: 63.818s total
building_sf1: 4.96s (external: 1.632s, internal: 3.328s)
customer_sf1: 4.383s (external: 1.502s, internal: 2.881s)
driver_sf1: 6.459s (external: 1.246s, internal: 5.213s)
trip_sf1: 10.9s (external: 1.641s, internal: 9.259s)
vehicle_sf1: 4.216s (external: 1.36s, internal: 2.856s)
zone_sf1: 32.9s (external: 1.262s, internal: 31.638s)
Results saved to bigquery_sf1_results.json
Running q1... 1.79s (114 rows)
Results saved to bigquery_sf1_results.json
Running q2... 2.78s (1 rows)
Results saved to bigquery_sf1_results.json
Running q3... 2.71s (22 rows)
Results saved to bigquery_sf1_results.json
Running q4... 163.18s (258 rows)
Results saved to bigquery_sf1_results.json
Running q5... 10.49s (316691 rows)
Results saved to bigquery_sf1_results.json
Running q6... 171.93s (3 rows)
Results saved to bigquery_sf1_results.json
Running q7... 15.95s (6000000 rows)
Results saved to bigquery_sf1_results.json
Running q8... 4.46s (415 rows)
Results saved to bigquery_sf1_results.json
Running q9... 2.03s (37 rows)
Results saved to bigquery_sf1_results.json
Running q10... TIMEOUT: Query q10 timed out after 600 seconds (process killed)
Results saved to bigquery_sf1_results.json
Running q11... 312.18s (1 rows)
Results saved to bigquery_sf1_results.json
Running q12... TIMEOUT: Query q12 timed out after 600 seconds (process killed)
Results saved to bigquery_sf1_results.json
================================================================================
BENCHMARK SUMMARY
================================================================================
Query bigquery -------------------------
q1 1.79s q2 2.78s q3 2.71s q4 163.18s q5 10.49s q6 171.93s q7 15.95s q8 4.46s q9 2.03s q10 TIMEOUT q11 312.18s q12 TIMEOUT -------------------------
Total 687.50s Load Time 63.82s Combined 751.32s

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@paleolimbot