Skip to content

gh-89240: Limit multiprocessing.Pool to 61 workers on Windows - #102920

Closed
aisk wants to merge 1 commit into
python:mainfrom
aisk:limit-pool-size
Closed

gh-89240: Limit multiprocessing.Pool to 61 workers on Windows#102920
aisk wants to merge 1 commit into
python:mainfrom
aisk:limit-pool-size

Conversation

@aisk

@aiskaisk commented Mar 22, 2023

Copy link
Copy Markdown
Member

@erlend-aaslanderlend-aasland changed the title gh-89240: limit multiprocessing.Pool to 61 workers on windowsgh-89240: Limit multiprocessing.Pool to 61 workers on WindowsJan 6, 2024

@hauntsaninjahauntsaninja left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks reasonable to me, compare to https://github.com/python/cpython/pull/13132/files. Although that PR complains 63 is the max and the overhead is 2 objects.

@aisk

aisk commented Jan 7, 2024

Copy link
Copy Markdown
MemberAuthor

It looks like #107873 can totally resolve the original issue if it has been merged, rather than pointing out the limitations in document and error messages like this PR.
So I think it's better to wait until #107873 is merged and close the current PR, or if it's not, then we can restart the review process.

@zooba

zooba commented Jan 8, 2024

Copy link
Copy Markdown
Member

My PR is waiting on reviews and/or testing. If a couple of people want to confirm that it works, then we can merge it.

Otherwise, this PR looks fine to me.

@aisk

aisk commented Feb 25, 2024

Copy link
Copy Markdown
MemberAuthor

Since #107873 has been merged, this issue can be closed now. Still, thank you to everyone who reviewed this!

@aiskaisk closed this Feb 25, 2024
@aisk
aisk deleted the limit-pool-size branch February 25, 2024 14:50
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@aisk@zooba@hauntsaninja@bedevere-bot