Skip to content

Add proper CMake build for extension_parallel - #8938

Merged
swolchok merged 7 commits into
mainfrom
gh/swolchok/306/head
Mar 5, 2025
Merged

Add proper CMake build for extension_parallel#8938
swolchok merged 7 commits into
mainfrom
gh/swolchok/306/head

Conversation

@swolchok

Copy link
Copy Markdown
Contributor

Previously it was copied in several places per executorch_srcs.cmake.

Needed for #8932

Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).

[ghstack-poisoned]
@pytorch-bot

pytorch-botBot commented Mar 4, 2025

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/8938

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 9fdebee with merge base 5dd96c3 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-botfacebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 4, 2025
swolchok added a commit that referenced this pull request Mar 4, 2025
Previously it was copied in several places per executorch_srcs.cmake.
Needed for #8932
Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).
ghstack-source-id: 333d1c9
ghstack-comment-id: 2698715235
Pull Request resolved: #8938

@larryliu0820larryliu0820 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the difference between extension_threadpool and extension_parallel?

@swolchok

Copy link
Copy Markdown
ContributorAuthor

What is the difference between extension_threadpool and extension_parallel?

extension_threadpool lives in extension/threadpool, and extension_parallel lives in extension/parallel. they're different code.

@swolchok

Copy link
Copy Markdown
ContributorAuthor

fixed tests -- forgot to git add extension/parallel/CMakeLists.txt

[ghstack-poisoned]
swolchok added a commit that referenced this pull request Mar 4, 2025
Previously it was copied in several places per executorch_srcs.cmake.
Needed for #8932
Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).
ghstack-source-id: d491783
ghstack-comment-id: 2698715235
Pull Request resolved: #8938
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
swolchok added a commit that referenced this pull request Mar 5, 2025
Previously it was copied in several places per executorch_srcs.cmake.
Needed for #8932
Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).
ghstack-source-id: d09bf5e
ghstack-comment-id: 2698715235
Pull Request resolved: #8938
@swolchok
swolchok merged commit cca6917 into mainMar 5, 2025
@swolchok
swolchok deleted the gh/swolchok/306/head branch March 5, 2025 18:08
zonglinpeng pushed a commit that referenced this pull request Mar 6, 2025
Previously it was copied in several places per executorch_srcs.cmake.
Needed for #8932
Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).
kedarnath03 pushed a commit to kedarnath03/executorch that referenced this pull request Jun 25, 2025
Previously it was copied in several places per executorch_srcs.cmake.
Needed for #8932
Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).
ghstack-source-id: d09bf5e
ghstack-comment-id: 2698715235
Pull Request resolved: pytorch/executorch#8938
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.release notes: buildChanges related to build, including dependency upgrades, build flags, optimizations, etc.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@swolchok@larryliu0820@kirklandsign@facebook-github-bot