Arm backend: Updating tests for 16A8W ops which are supported by Ninja91 · Pull Request #14945 · pytorch/executorch

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 · 2025-10-09T15:46:39Z

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure.

Differential Revision: D84262200

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

pytorch-bot · 2025-10-09T15:46:43Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14945

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 2 Cancelled Jobs, 4 Unrelated Failures

As of commit dc77814 with merge base 4bdd3df ():

NEW FAILURES - The following jobs have failed:

pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 0aa935d448602cac26941a8e35a3ee90ceea037a4aa4decb110c77431d7adb38 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 423dd21a224dec6c91464a92e9350297de15927a487e1182d2cdaa33a14d5dbb /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t ef97f4460a422a23e73818d5c2631629f66d01e7bd174fcaa74d82980172edd8 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d69bf7b2ba7b2b679480b089d9d3622f24f9149af65bc2b65c8f93526520382 /exec failed with exit code 1
Test CUDA Builds / test-voxtral-cuda-e2e / linux-job (gh)
RuntimeError: Command docker exec -t 33757ec99b56aa1f787f1409280c9648789ec899ee15da822e974c96c0bf596f /exec failed with exit code 2

CANCELLED JOBS - The following jobs were cancelled. Please retry:

trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
RuntimeError: Command docker exec -t e0614da916e0c6b3c9cbf9d7e2d7e90f1caea9885ad6c18016772533fab5e291 /exec failed with exit code 1
trunk / test-models-macos-coreml (mv3) / macos-job (gh)
##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / unittest / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.
trunk / unittest-release / windows / windows-job (gh) (trunk failure)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-codesync · 2025-10-09T15:46:47Z

@Ninja91 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84262200.

github-actions · 2025-10-09T15:52:36Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

digantdesai

Nice!

zingo · 2025-10-13T09:00:12Z

@Ninja91 this seem to have broke arm testing :(
I spot this error in the logs
2025-10-10T09:57:35.5641273Z FAILED backends/arm/test/ops/test_slice.py::test_slice_tensor_16a8w_u85_INT16[ones_slice_4] - RuntimeError: Corstone simulation failed:

Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 requested a review from digantdesai as a code owner October 9, 2025 15:46

meta-claBot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 9, 2025

meta-codesyncBot added fb-exported meta-exported labels Oct 9, 2025

Ninja91 requested a review from gggekov October 9, 2025 15:56

Ninja91 added the partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm label Oct 9, 2025

Ninja91 requested a review from SaoirseARM October 9, 2025 16:04

Ninja91 force-pushed the export-D84262200 branch from 538da42 to ec1e5b9Compare October 9, 2025 16:05

Ninja91 force-pushed the export-D84262200 branch from ec1e5b9 to 71ec0d2Compare October 9, 2025 16:05

Ninja91 force-pushed the export-D84262200 branch 2 times, most recently from 34c4d3c to 5e3c749Compare October 10, 2025 05:21

Ninja91 force-pushed the export-D84262200 branch from 5e3c749 to 4a5105bCompare October 10, 2025 05:23

Updating tests for 16A8W ops which are supported (pytorch#14945)
dc77814
Summary: Updating the TOSA, U55 & U85 tests to remove xfails. These ops are supported now and updating tests to not expect failure. Differential Revision: D84262200

Ninja91 force-pushed the export-D84262200 branch from 4a5105b to dc77814Compare October 10, 2025 07:10

gggekov added the ciflow/trunk label Oct 10, 2025

digantdesai approved these changes Oct 10, 2025
View reviewed changes

zingo changed the title ~~Updating tests for 16A8W ops which are supported~~Arm backend: Updating tests for 16A8W ops which are supportedOct 11, 2025

Ninja91 merged commit 50a10a2 into pytorch:mainOct 12, 2025
286 of 298 checks passed