[ExecuTorch][WebGPU] Add certified scoped output suppression by JCNTH · Pull Request #21127 · pytorch/executorch

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

JCNTH · 2026-07-22T04:10:53Z

Stack from ghstack (oldest at bottom):

When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).

Key changes:

WebGPUExecutionOptions.{h,cpp}: certificate struct, RAII
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
WebGPUGraph.{cpp,h}: resolve the certified output ordinal and skip its
dispatch range and readback when suppression is active.
WebGPUBackend.cpp: thread the scoped option through execution.
@exported-using-ghexport

Differential Revision: D113171751

[ghstack-poisoned]

pytorch-bot · 2026-07-22T04:10:56Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 45 Pending, 1 Unrelated Failure

As of commit 53fc165 with merge base 28a7fac ():

NEW FAILURES - The following jobs have failed:

Cadence Build & Test / cpu-build / build (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8B8A:236993:4FE4919:10E03256:6A760B83 and timestamp 2026-08-07 16:44:51 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CBD2:34749A:63574F1:1506C720:6A760B7E and timestamp 2026-08-07 16:44:46 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID EC16:1196:85E5B8A:1C25E96C:6A760B7B and timestamp 2026-08-07 16:44:43 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID AB78:30BA9A:39A2BAD:C4D019B:6A760B79 and timestamp 2026-08-07 16:44:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID B854:2AB583:90DC79E:1E6E2424:6A760B89 and timestamp 2026-08-07 16:44:57 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID BFAC:285D:4A5D3AA:FC51B32:6A760B7A and timestamp 2026-08-07 16:44:42 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 8662:362BDF:38B026C:C0ED9E4:6A760B77 and timestamp 2026-08-07 16:44:39 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID CE88:1B7A58:8D9BB00:1DB47249:6A760B81 and timestamp 2026-08-07 16:44:49 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting
pull / test-parakeet-xnnpack-linux / linux-job (gh)
##[error]An error occurred trying to start process '/usr/bin/bash' with working directory '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch'. No such file or directory
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
##[error]API rate limit exceeded for installation. If you reach out to GitHub Support for help, please include the request ID 99A8:AD45:36FA48A:BB4DD64:6A760B93 and timestamp 2026-08-07 16:45:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) - https://docs.github.com/en/rest/using-the-rest-api/getting-started-with-the-rest-api#rate-limiting

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh) (matched linux rule in flaky-rules.json)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions · 2026-07-22T04:11:40Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[ghstack-poisoned]

fbsource master [ghstack-poisoned]

@JCNTH

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #21127 by @JCNTH ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/JCNTH/103/orig @diff-train-skip-merge --------- Co-authored-by: Julian Ng-Thow-Hing <juliannth@meta.com> Co-authored-by: Julian Ng-Thow-Hing <107437036+JCNTH@users.noreply.github.com>

Update
8aafb78
[ghstack-poisoned]

JCNTH requested review from kirklandsign and larryliu0820 as code owners July 22, 2026 04:10

JCNTH temporarily deployed to cadence July 22, 2026 04:10 — with GitHub Actions Inactive

meta-claBot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 22, 2026

JCNTH temporarily deployed to cadence July 22, 2026 04:35 — with GitHub Actions Inactive

Update
bc731fa
[ghstack-poisoned]

JCNTH temporarily deployed to cadence July 22, 2026 17:33 — with GitHub Actions Inactive

meta-codesyncBot added the meta-exported label Jul 22, 2026

JCNTH had a problem deploying to cadence July 22, 2026 17:58 — with GitHub Actions Error

Update
aaf3084
[ghstack-poisoned]

JCNTH temporarily deployed to cadence July 22, 2026 18:27 — with GitHub Actions Inactive

JCNTH temporarily deployed to cadence July 22, 2026 18:57 — with GitHub Actions Inactive

Update
2f37612
[ghstack-poisoned]

JCNTH temporarily deployed to cadence July 23, 2026 02:11 — with GitHub Actions Inactive

This was referenced Jul 30, 2026
[ExecuTorch][WebGPU] Preserve Linear and Q4 embedding params across dynamic resize #21482
Closed
[ExecuTorch][WebGPU] Preserve Linear and Q4 embedding params across dynamic resize #21483
Merged

psiddh approved these changes Jul 30, 2026
View reviewed changes

Update
9566ef3
[ghstack-poisoned]

JCNTH temporarily deployed to cadence July 31, 2026 16:46 — with GitHub Actions Inactive

JCNTH temporarily deployed to cadence July 31, 2026 17:10 — with GitHub Actions Inactive

Update
c23d990
[ghstack-poisoned]

JCNTH temporarily deployed to cadence July 31, 2026 21:21 — with GitHub Actions Inactive

JCNTH temporarily deployed to cadence July 31, 2026 21:50 — with GitHub Actions Inactive

Update
781700b
[ghstack-poisoned]

JCNTH temporarily deployed to cadence August 5, 2026 19:55 — with GitHub Actions Inactive

JCNTH temporarily deployed to cadence August 5, 2026 20:36 — with GitHub Actions Inactive

Rebase onto latest
53fc165
fbsource master [ghstack-poisoned]

JCNTH temporarily deployed to cadence August 7, 2026 16:36 — with GitHub Actions Inactive

JCNTH temporarily deployed to cadence August 7, 2026 17:10 — with GitHub Actions Inactive

meta-codesyncBot merged commit af985cd into gh/JCNTH/103/baseAug 7, 2026
170 of 182 checks passed

meta-codesyncBot deleted the gh/JCNTH/103/head branch August 7, 2026 17:19

meta-codesyncBottemporarily deployed to cherry-pick-bot August 7, 2026 17:19 Inactive

pytorchbot mentioned this pull request Aug 7, 2026
[ExecuTorch][WebGPU] Add certified scoped output suppression #21646
Merged