Add Nvfatbin Bindings by isVoid · Pull Request #1467 · NVIDIA/cuda-python

isVoid · 2026-01-13T04:35:16Z

Description

closes#156

Checklist

New or existing tests cover these changes.
The documentation is up to date with these changes.

copy-pr-bot · 2026-01-13T04:35:20Z

Auto-sync is disabled for ready for review pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

…bin-bindings

leofang · 2026-01-13T21:29:30Z

FYI @rparolin all of these are generated code except for the tests. There is an internal MR targeting the codegen for this.

leofang · 2026-01-15T15:12:39Z

+ if err != nvrtc.nvrtcResult.NVRTC_SUCCESS:
+ raise RuntimeError(repr(err))
+
+ err, program_handle = nvrtc.nvrtcCreateProgram(CODE.encode(), b"", 0, [], [])


Not a blocker for this PR, but I think we have some helper functions for NVRTC that can be used in cuda-bindings tests, so that we do not have to reimplement them in this file.

Agreed, I saw this pattern showed up in test_nvjitlink as well. Perhaps a shared fixture that returns an nvrtc artifact.

leofang · 2026-01-15T15:13:27Z

/ok to test 8e75d8a

isVoid · 2026-01-15T22:08:25Z

/ok to test 965c53b

leofang · 2026-01-15T22:25:53Z

E cuda.bindings._internal.utils.FunctionNotFoundError: function nvFatbinAddTileIR is not found

Need to skip the tile IR test for nvFatbin < 13.1

isVoid · 2026-01-15T22:58:25Z

stderr = b'gcc: No such file or directory\nnvcc fatal : Failed to preprocess host compiler properties.\n'

This shows in some CI environment there's nvcc installed but it's not properly setup due to missing host compiler.

isVoid · 2026-01-15T23:37:23Z

/ok to test 4baeecd

isVoid · 2026-01-16T00:50:26Z

/ok to test 4c2f3f3

leofang · 2026-01-16T02:39:56Z

stderr = b'gcc: No such file or directory\nnvcc fatal : Failed to preprocess host compiler properties.\n'
This shows in some CI environment there's nvcc installed but it's not properly setup due to missing host compiler.

Yup! See #1467 (comment).

leofang · 2026-01-16T03:03:35Z

 [project.optional-dependencies]
 all = [
- "cuda-toolkit[nvrtc,nvjitlink,nvvm]==13.*",
+ "cuda-toolkit[nvrtc,nvjitlink,nvvm,nvfatbin]==13.*",


@kkraus14 this minds me a discussion we had a few months ago -- One day installing cuda-binding[all] would bring in the whole CTK 😂

leofang · 2026-01-16T03:06:39Z

LGTM! Thanks, @isVoid!

leofang · 2026-01-16T14:15:07Z

/ok to test 3e071e2

github-actions · 2026-01-16T15:13:07Z

Backport failed for 12.9.x, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 12.9.x
git worktree add -d .worktree/backport-1467-to-12.9.x origin/12.9.x
cd .worktree/backport-1467-to-12.9.x
git switch --create backport-1467-to-12.9.x
git cherry-pick -x 1af5db98e2f39a11c3ebd82190ca63156e052a09

leofang · 2026-01-16T15:14:47Z

@isVoid because of #965 the backport bot does not work (a workflow file is touched). Could you manually cherry pick?

github-actions · 2026-01-16T15:24:50Z

Doc Preview CI
Preview removed because the pull request was closed or merged.

* initial localized test * add rest of APIs * remove local skips * regenerate for CUDA 13.1 and with tile IR API * nvfatbinError -> nvFatbinError * regenerate for get_error_string * enable object creation and testing * remove the LTOIR mismatching arch failure test * encode a legal tileIR into test * update the license year * add an embedded tile program for re-generation * license date: 2026 * cdef const char * * add dependency for CI * add TODO to locate nvcc file * add documentation and release notes * skip tileIR test for <13.1 installation * add an nvcc smoke test to better determine compiler usability * fix typo * add nvfatbin.rst --------- Co-authored-by: Michael Wang <isVoid@users.noreply.github.com>

isVoid added 2 commits January 12, 2026 13:54

initial localized test
2d8c99a

add rest of APIs
9b1a559

kkraus14 reviewed Jan 13, 2026
View reviewed changes

Comment threadcuda_bindings/cuda/bindings/_internal/nvfatbin.pxd Outdated
Comment threadcuda_bindings/cuda/bindings/_internal/nvfatbin.pxd

isVoid added 2 commits January 13, 2026 10:30

remove local skips
a979dd0

regenerate for CUDA 13.1 and with tile IR API
fc4203e

leofang requested review from leofang and mdboom January 13, 2026 19:00

leofang assigned isVoid Jan 13, 2026

leofang added P0 High priority - Must do! feature New feature or request cuda.bindings Everything related to the cuda.bindings module labels Jan 13, 2026

leofang added this to the cuda-python 13-next, 12-next milestone Jan 13, 2026

Merge branch 'main' of github.com:NVIDIA/cuda-python into wangm/nvfat…
344f735
…bin-bindings

rparolin reviewed Jan 13, 2026
View reviewed changes

Comment threadcuda_bindings/cuda/bindings/_internal/nvfatbin_linux.pyx

rparolin reviewed Jan 13, 2026
View reviewed changes

Comment threadcuda_bindings/cuda/bindings/_internal/nvfatbin_linux.pyx

nvfatbinError -> nvFatbinError
e7ace35

leofang reviewed Jan 13, 2026
View reviewed changes

Comment threadcuda_bindings/tests/test_nvfatbin.py Outdated

isVoid added 5 commits January 14, 2026 11:55

regenerate for get_error_string
d962f61

enable object creation and testing
bd868bd

remove the LTOIR mismatching arch failure test
d11cf02

encode a legal tileIR into test
d995809

update the license year
8e75d8a

kkraus14 approved these changes Jan 15, 2026
View reviewed changes

Comment threadcuda_bindings/tests/test_nvfatbin.py Outdated
Comment threadcuda_bindings/tests/test_nvfatbin.py Outdated

leofang reviewed Jan 15, 2026
View reviewed changes

leofang added the to-be-backported Trigger the bot to raise a backport PR upon merge label Jan 15, 2026

leofang reviewed Jan 15, 2026
View reviewed changes

Comment threadcuda_bindings/cuda/bindings/_internal/nvfatbin.pxd Outdated

This comment has been minimized.
Sign in to view

isVoid added 5 commits January 15, 2026 12:23

license date: 2026
cda0e29

cdef const char *
2e53f46

add dependency for CI
d7dfdb8

add TODO to locate nvcc file
ff8f6a2

add documentation and release notes
965c53b

isVoid added 2 commits January 15, 2026 15:00

skip tileIR test for <13.1 installation
2b54279

add an nvcc smoke test to better determine compiler usability
4baeecd

fix typo
4c2f3f3

leofang approved these changes Jan 16, 2026
View reviewed changes

leofang reviewed Jan 16, 2026
View reviewed changes

Comment threadcuda_bindings/docs/source/api.rst

add nvfatbin.rst
3e071e2

leofang enabled auto-merge (squash) January 16, 2026 15:01

leofang merged commit 1af5db9 into NVIDIA:mainJan 16, 2026
80 checks passed

leofang mentioned this pull request Jan 16, 2026
[FEA]: Tests for ltoir, fatbin, object, and library constructors #663
Closed
1 task

isVoid mentioned this pull request Jan 16, 2026
Backport nvFatbin Bindings to 12.9.x #1511
Merged

leofang modified the milestones: cuda.bindings 13.1.2 & 12.9.6, cuda.bindings next Feb 17, 2026

Uh oh!

Conversation

isVoid commented Jan 13, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Checklist

Uh oh!

copy-pr-botBot commented Jan 13, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

leofang commented Jan 13, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

leofangJan 15, 2026

Choose a reason for hiding this comment

Uh oh!

isVoidJan 15, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

leofang commented Jan 15, 2026

Uh oh!

Uh oh!

This comment has been minimized.

isVoid commented Jan 15, 2026

Uh oh!

leofang commented Jan 15, 2026

Uh oh!

isVoid commented Jan 15, 2026

Uh oh!

isVoid commented Jan 15, 2026

Uh oh!

isVoid commented Jan 16, 2026

Uh oh!

leofang commented Jan 16, 2026

Uh oh!

leofangJan 16, 2026

Choose a reason for hiding this comment

Uh oh!

leofang commented Jan 16, 2026

Uh oh!

Uh oh!

leofang commented Jan 16, 2026

Uh oh!

Uh oh!

github-actionsBot commented Jan 16, 2026

Uh oh!

leofang commented Jan 16, 2026

Uh oh!

github-actionsBot commented Jan 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

isVoid commented Jan 13, 2026•
edited
Loading

isVoidJan 15, 2026•
edited
Loading