Skip to content

tests: add testing for Python 3.15 - #17948

Closed
parthea wants to merge 23 commits into
mainfrom
add-testing-315
Closed

tests: add testing for Python 3.15#17948
parthea wants to merge 23 commits into
mainfrom
add-testing-315

Conversation

@parthea

@partheaparthea commented Jul 30, 2026•
edited
Loading

Copy link
Copy Markdown
Contributor

[WIP] This PR depends on #17438

gemini-code-assist[bot]
gemini-code-assistBot reviewed Jul 30, 2026
View reviewed changes

@gemini-code-assistgemini-code-assistBot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces Python 3.15 support across multiple packages, adds a batching script (ci/get_batches.py) for test execution, and updates test runners to support Python 3.15. Feedback on the changes includes correcting the handling of preview-packages in ci/run_conditional_tests.sh, moving the shebang to the first line in ci/get_batches.py, removing duplicate skip blocks in packages/google-cloud-bigtable/noxfile.py, and correcting a package constraint name in packages/google-cloud-spanner-dbapi-driver.

Comment threadci/run_conditional_tests.sh Outdated
Comment threadci/get_batches.py
Comment threadpackages/google-cloud-bigtable/noxfile.py Outdated
Comment threadpackages/google-cloud-spanner-dbapi-driver/testing/constraints-3.15.txt
parthea added 10 commits July 30, 2026 17:33
@parthea
git checkout origin/main .github/workflows/unittest.yml
c5e3980
@parthea
git checkout origin/main ci/run_conditional_tests.sh
46fdb3d
@parthea
Squashed commit of the following:
5f5d63b
commit 73ed7ae
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jul 30 09:58:32 2026 -0700
experiemting with inner-shard parallel runs
commit 4822342
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jul 30 09:58:16 2026 -0700
dded uv seed to allow pip in venvs
commit f40572c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jul 30 09:46:00 2026 -0700
use uv
commit 7c29040
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jul 30 09:45:30 2026 -0700
obey test all flag in lint checks
commit b5639c6
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 23:37:09 2026 -0700
fixing mypy check
commit 8816f61
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 23:33:15 2026 -0700
revered back to simpler sharding algorithm
commit c16385f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 22:41:43 2026 -0700
trying different shard algorithm
commit 9bd04b8
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 21:23:34 2026 -0700
make sure up to MAX_SHARDS are used
commit 8f12c4e
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 21:17:24 2026 -0700
improved sharding algorithnm
commit 4e6f3fc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 20:39:24 2026 -0700
group preview packages with main package in shards
commit 36c55dc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 19:07:53 2026 -0700
adjust how package names are displayed
commit 796eedb
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 18:53:22 2026 -0700
improve how multiple package directories are handled
commit 09d705a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 16:38:34 2026 -0700
improved git diff logic for preview packages
commit 4f3b012
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 16:29:59 2026 -0700
show preview in shard name for preview packages
commit f8da556
Merge: e394b882d1372b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 29 15:52:20 2026 -0700
Merge branch 'main' into ci_sharding
commit e394b88
Merge: eefea36d328e3b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 28 10:35:23 2026 -0700
Merge branch 'main' into ci_sharding
commit eefea36
Merge: 7ca017153b48ae
Author: Daniel Sanche <sanche@google.com>
Date: Mon Jul 27 09:27:26 2026 -0700
Merge branch 'main' into ci_sharding
commit 7ca0171
Merge: 4e8892c4f21b8b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jul 24 16:28:08 2026 -0700
Merge branch 'main' into ci_sharding
commit 4e8892c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 22 12:22:11 2026 -0700
fixed truncation issues
commit 4382fcc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Wed Jul 22 12:15:23 2026 -0700
added comment
commit 04fb332
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jul 17 14:15:40 2026 -0700
changed sqlalchemy-spanner coverage value
commit a05d1fb
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jul 17 11:54:34 2026 -0700
update spanner coveragerc
commit fb71278
Merge: eaf75e995da740
Author: Daniel Sanche <sanche@google.com>
Date: Fri Jul 17 11:53:23 2026 -0700
Merge branch 'main' into ci_sharding
commit eaf75e9
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 13:22:17 2026 -0700
print only count for successes
commit c70613a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 13:19:30 2026 -0700
moved script out of yaml
commit f1eb3a4
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 13:14:33 2026 -0700
added comments to sharding script
commit cf3de20
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 13:10:55 2026 -0700
added back subdirs
commit d04104d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 13:08:17 2026 -0700
cleaned up conditional tests
commit e35ea34
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 12:57:16 2026 -0700
removed duplication
commit 010e1ad
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 12:53:49 2026 -0700
remove empty files
commit a4566cf
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 12:53:30 2026 -0700
use all runtimes in coverage
commit 60a3e74
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 12:01:11 2026 -0700
fixed coverage condition
commit e1bedf1
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 11:57:13 2026 -0700
avoid going over max_shards
commit 6c0566f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 10:23:30 2026 -0700
use 3.10 as lower bound
commit 5bfe2d1
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 10:19:58 2026 -0700
only upload coverage for first and last supported version
commit cd33370
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 10:00:28 2026 -0700
undo fast-path optimization
commit fa06713
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 09:43:56 2026 -0700
added fast path for coverage check
commit 45b5e68
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 09:26:09 2026 -0700
define package weights in yaml
commit e453d2c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 09:21:08 2026 -0700
added test files
commit e611fe7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 09:17:22 2026 -0700
made max shards configurable
commit da2f41e
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 09:15:52 2026 -0700
use RAM disk for coverage results
commit 073dc07
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Tue Jul 7 09:11:02 2026 -0700
Revert "combine coverage in shards"
This reverts commit b9f750d.
commit b9f750d
Author: Daniel Sanche <sanche@google.com>
Date: Mon Jul 6 22:02:13 2026 -0700
combine coverage in shards
Updated the unittest workflow to include coverage installation and combine coverage results for better reporting.
commit b4f9d9d
Author: Daniel Sanche <sanche@google.com>
Date: Mon Jul 6 21:32:36 2026 -0700
updated find call
commit 15421a7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 19:05:41 2026 -0700
removed empty file
commit b20bb1a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 18:58:32 2026 -0700
enable test against ces
commit deaabe7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 18:50:49 2026 -0700
fixing bug in coverage search
commit 5cb0e26
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 18:46:55 2026 -0700
added pip cache
commit bdc977a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 18:32:21 2026 -0700
end early if fail_under = 0
commit 8ea10ec
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 18:18:33 2026 -0700
change MAX_JOBS
commit b4733da
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 18:18:25 2026 -0700
fix coverage files
commit 964e142
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 18:16:36 2026 -0700
optimized coverage step
commit 80f0061
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 16:53:58 2026 -0700
avoid combining all coverage files
commit e4495b8
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 16:45:48 2026 -0700
fixed typo
commit f14d489
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 15:18:01 2026 -0700
pack shards alphabetically
commit 2e9bafc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 15:11:57 2026 -0700
added additional weights
commit 7ccca59
Merge: 8c4d2dd6a49390
Author: Daniel Sanche <sanche@google.com>
Date: Mon Jul 6 14:26:07 2026 -0700
Merge branch 'main' into ci_sharding
commit 8c4d2dd
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 14:25:39 2026 -0700
resolve merge conflict
commit 92626bd
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 14:23:17 2026 -0700
parallelize final cover check
commit a1fab95
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 14:19:16 2026 -0700
use pacakge weights instead of isolation
commit 89e5499
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 13:16:30 2026 -0700
changed shard names
commit 40d31e3
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 13:12:41 2026 -0700
isolated shards should be included in max_shard count
commit ee7cabc
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 12:35:03 2026 -0700
isolate specific packages
commit c99a693
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 12:27:23 2026 -0700
increased shard count
commit 6123e7a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 12:22:47 2026 -0700
revered unrelated changes
commit fb90860
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 11:48:19 2026 -0700
don't trigger on label changes
commit 8fb68d3
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 11:37:32 2026 -0700
re-run when label added
commit 6c1be8b
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Mon Jul 6 11:30:23 2026 -0700
added github tag to test all packages
commit e34b654
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 18 17:03:08 2026 -0700
reverted systen test changes
commit 72503de
Merge: 7b565a4690c15d
Author: Daniel Sanche <sanche@google.com>
Date: Thu Jun 18 16:59:37 2026 -0700
Merge branch 'main' into ci_sharding
commit 7b565a4
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 19:09:44 2026 -0700
added no-fail .coveragerc to sqlalchemy-spanner
commit ae05642
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 19:09:16 2026 -0700
added summary to cover step
commit 83ca04a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 18:10:46 2026 -0700
added known-bad package
commit 886d6d9
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 18:07:20 2026 -0700
unit tests fail if initialize fails
commit cf554ca
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 18:02:52 2026 -0700
add label to number in shard
commit 9c80a51
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 18:00:18 2026 -0700
rename tests
commit acdfb18
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 17:49:45 2026 -0700
iterating on shard logic
commit c3cf49e
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 17:43:10 2026 -0700
change shard logic
commit b36b559
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 17:35:40 2026 -0700
fixed typo
commit a5cc497
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 17:29:36 2026 -0700
activated 11th package (enable sharding)
commit 980d8eb
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 17:10:15 2026 -0700
change default for coverage percent
commit 3633089
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 17:07:00 2026 -0700
10 packages total
commit 7bb323c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 16:43:46 2026 -0700
activated more packages
commit b00967f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 15:17:58 2026 -0700
loosen firestore coverage requirement
commit cf1a1f1
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 15:12:07 2026 -0700
use individual coverage checks
commit 71f444a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 13:55:50 2026 -0700
fail fast
commit a0f5c9a
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 13:50:18 2026 -0700
allow hidden files for cover
commit 1cd8c1f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 13:28:15 2026 -0700
attempt fix for cover
commit c49b06d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 13:17:10 2026 -0700
attempt cover fix
commit ff1274f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 12:37:01 2026 -0700
remove global run on ci/ change
commit 32968a9
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 12:33:23 2026 -0700
add shard descriptions
commit 8b825d5
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 12:20:49 2026 -0700
updated lint and mypy logic
commit fd5792d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 12:20:31 2026 -0700
removed many SHARD_TEST files
commit e6167bd
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 11:43:25 2026 -0700
system tests print all logs in main build log
commit 6e3531d
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 11:25:24 2026 -0700
removed sqlalchemy-spanner from touched packages
commit 46d1583
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 11:19:01 2026 -0700
fixed lint/mypy runs
commit de74a68
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 10:42:56 2026 -0700
update sharding logic
commit d8dd522
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 10:38:34 2026 -0700
update system tests to show logs for each target
commit 49cac0f
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 10:35:12 2026 -0700
attempt fix for lint
commit 15916df
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Fri Jun 12 09:26:18 2026 -0700
split out system test logs
commit af4d10c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 21:33:04 2026 -0700
fix system tests
commit a450254
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 19:01:06 2026 -0700
fix coverage
commit 74f1ef7
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 17:36:13 2026 -0700
fixed tests
commit 73ab091
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 17:31:58 2026 -0700
changed shard params
commit 3c8d057
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 17:29:10 2026 -0700
added unit-complete to gather all shards
commit 02c7653
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 17:25:15 2026 -0700
added sharding test file
commit 9ad0f0c
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 17:24:57 2026 -0700
added changes to many packages for testing
commit a7502d4
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 17:21:14 2026 -0700
run system tests concurrently
commit 01d4753
Author: Daniel Sanche <d.sanche14@gmail.com>
Date: Thu Jun 11 17:21:04 2026 -0700
added unit test sharding
@parthea
restore 3.15
b6cbd62
@parthea
restore 3.15
2f8483a
@parthea
address zizmor
ea8c9a6
@parthea
address feedback
6eb430f
@parthea
temporarily speed up feedback
f394a59
@parthea
temporarily speed up feedback
527dcae
@parthea
revert
6f01ed4
@partheaparthea added the unit_test:all_packages debug label used to trigger unit tests against all packages in a PR label Jul 30, 2026
@partheaparthea closed this Jul 30, 2026
@partheaparthea reopened this Jul 30, 2026
@parthea

parthea commented Jul 30, 2026

Copy link
Copy Markdown
ContributorAuthor

Strategy for job 'unit' produced 264 configurations which exceeds the maximum of 256 configurations

@partheaparthea self-assigned this Jul 31, 2026
@partheaparthea closed this Jul 31, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer
@gemini-code-assistgemini-code-assist[bot]gemini-code-assist[bot] left review comments
Reviewers whose approvals may not affect merge requirements

Assignees

@partheaparthea

Labels

unit_test:all_packagesdebug label used to trigger unit tests against all packages in a PR

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@parthea