CI: Add Windows GPU runner for tests

[leofang]

Part of #277.

Based on offline discussion with our admin @aflat and @aterrel@kkraus14, as a stop-gap solution until we get our own runners we are setting up a GH-hosted runners to cover Windows. Because the rate is high, we pick only 1 Python version x 2 latest CUDA major versions (11.8 & 12.8) x 2 different ways of getting CUDA to keep the cost within $100 a month.

In terms of the implementation, the new workflow is largely the same as its Linux counterpart, except for the following changes since the VM image of choice (Windows 11 23H2) has nothing pre-installed:

• Windows has its own workflow file because using container or not cannot be matrix-parametrized (CI: Add Windows GPU runner for tests #444 (comment))
• Bash shell commands are migrated to Powershell using Perplexity + some manual changes (due to lack of Git for Windows)
  • The collateral derange is our own Bash-based fetch_ctk action cannot be used; instead, we switch to use Jimver/cuda-toolkit which has been approved by the admins
• CUDA driver is installed as part of the test CI (most time consuming part - 3m20s!)
  • Since the runner has a T4 GPU, the default mode is TCC
• Some of the job steps came from our prior work (Add Github actions CI for tests cupy-ci-poc/cupy#1)

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

@cryos@rwgk do you guys have clever ways about refactoring a workflow file? On the Windows runner, we cannot launch any container so this part must be removed:

cuda-python/.github/workflows/test-wheel.yml

Lines 32 to 38 in 7387715

	# Our self-hosted runners require a container
	# TODO: use a different (nvidia?) container
	container:
	options: -u root --security-opt seccomp=unconfined --shm-size 16g
	image: ubuntu:22.04
	env:
	NVIDIA_VISIBLE_DEVICES: ${{ env.NVIDIA_VISIBLE_DEVICES }}

but otherwise the remaining logic should be the same and preserved... Are there smarter ways than duplicating the file for Windows?

[cryos]

@cryos@rwgk do you guys have clever ways about refactoring a workflow file? On the Windows runner, we cannot launch any container so this part must be removed:

cuda-python/.github/workflows/test-wheel.yml

Lines 32 to 38 in 7387715

	# Our self-hosted runners require a container
	# TODO: use a different (nvidia?) container
	container:
	options: -u root --security-opt seccomp=unconfined --shm-size 16g
	image: ubuntu:22.04
	env:
	NVIDIA_VISIBLE_DEVICES: ${{ env.NVIDIA_VISIBLE_DEVICES }}

but otherwise the remaining logic should be the same and preserved... Are there smarter ways than duplicating the file for Windows?

I feel like there should be, searching turned up the same disappointing you cannot make container conditional on the matrix and you have to split the workflow which I agree is disappointing.

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

(spoke to George, the underlying image is changed now, let me restart the tests)

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

Looks like we hit https://github.com/orgs/community/discussions/138813... which is weird... I haven't seen this error in the previous project...

[leofang]

Unfortunately there is no way to route this issue to the right GitHub support person. Closing this for now.

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

/ok to test

[leofang]

This is ready for review! The PR description is updated.

[leofang]

The doc build failure

AttributeError: module 'sphinx.util.typing' has no attribute 'ForwardRef'

is due to Sphinx 8.2.0, let's fix it in a separate PR:

• Sphinx 8.2.0 failure (sphinx_toolbox.more_autodoc.typehints) sphinx-doc/sphinx#13362
• Newest Sphinx (8.2.0) + sphinx-toolbox + ReadTheDocs Failures sphinx-toolbox/sphinx-toolbox#178

[cryos]

Very cool, looks good to me.

[github-actions]

Doc Preview CI
Preview removed because the pull request was closed or merged.