tensor destroy by larryliu0820 · Pull Request #14686 · pytorch/executorch

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

larryliu0820 · 2025-09-30T08:10:07Z

Stack from ghstack (oldest at bottom):

Summary:

This diff introduce aoti_torch_delete_tensor_object for deleting tensors created during cuda backend inference.

Reviewed By:

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

pytorch-bot · 2025-09-30T08:10:11Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14686

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 49602cd with merge base db8d04f ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14687 * #14686 Summary: This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * #14688 * __->__ #14700 * #14686 Summary: This is a manual cherry pick of #14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * #14689 * __->__ #14688 * #14687 * #14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #14690 * __->__ #14689 * #14688 * #14687 * #14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #14690 * #14689 * #14688 * #14687 * #14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

@larryliu0820

This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#14686 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/76/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <larryliu@meta.com>

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * pytorch#14688 * __->__ pytorch#14700 * pytorch#14686 Summary: This is a manual cherry pick of pytorch#14687 This function introduce aoti_torch_create_tensor_from_blob_v2, a function that create tensor from data blob and custom stride and size. Worth to notice that unlike aoti_torch_empty_strided, the tensor created by aoti_torch_create_tensor_from_blob_v2 will not have the control of the memory blob. Therefore when we delete it, the memory will not be freed. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * pytorch#14689 * __->__ pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: Introduced aoti_torch__reinterpret_tensor, which creates a new tensor view that reinterprets the same underlying memory with custom shape and strides. Reviewed By: Differential Revision:

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * pytorch#14690 * __->__ pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: This diff introduce `aoti_torch_copy_`, the function for copying tensor inside cuda backend. Right now it only support copy between tensors with same dtype. Reviewed By: Differential Revision:

) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ pytorch#14690 * pytorch#14689 * pytorch#14688 * pytorch#14687 * pytorch#14686 Summary: this is a comprehensive update to use ET_CHECK macro to replace original if..else check for better follow et's law Reviewed By: Differential Revision:

tensor destroy
49602cd
Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: [ghstack-poisoned]

meta-claBot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 30, 2025

This was referenced Sep 30, 2025
aoti_torch_create_tensor_from_blob_v2 #14687
Merged
aoti_torch__reinterpret_tensor #14688
Merged
aoti_torch_copy_ #14689
Merged
use ET_CHECK macro for sanity checks in memory shim layer #14690
Merged

larryliu0820 added the release notes: desktop for desktop/laptop workstream label Sep 30, 2025

manuelcandales approved these changes Sep 30, 2025
View reviewed changes

larryliu0820 merged commit ac2cc6c into gh/larryliu0820/76/baseSep 30, 2025
131 of 141 checks passed

larryliu0820 deleted the gh/larryliu0820/76/head branch September 30, 2025 16:59

larryliu0820 temporarily deployed to cherry-pick-bot September 30, 2025 16:59 — with GitHub Actions Inactive

pytorchbot mentioned this pull request Sep 30, 2025
tensor destroy #14698
Merged

larryliu0820 added a commit that referenced this pull request Sep 30, 2025
tensor destroy
f4a283a
Summary: This diff introduce `aoti_torch_delete_tensor_object` for deleting tensors created during cuda backend inference. Reviewed By: ghstack-source-id: 9b47d11 Pull Request resolved: #14686

larryliu0820 mentioned this pull request Sep 30, 2025
aoti_torch_create_tensor_from_blob_v2 #14700
Merged